00000001:02000400:1.0F:1789683180.990175:0:3304:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1789683196.485639:0:3525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789683197.740001:0:3567:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 749 MB/s 00000001:01000000:0.0:1789683197.990229:0:3567:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1023 MB/s 00000001:01000000:3.0:1789683198.240019:0:3567:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 7915 MB/s 00000020:02000000:3.0:1789683198.600219:0:3616:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g12a437a 00000400:02000000:1.0:1789683199.209147:0:3631:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.150@tcp [8/256/0/180] 00008000:02000000:3.0:1789683202.132909:0:3780:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789683247.347100:0:5747:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789683264.366213:0:6498:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789683264.366219:0:6498:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789683264.366221:0:6498:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789683264.366418:0:6498:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005f244228 00000080:02000400:3.0:1789683264.366971:0:6498:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789683264.375943:0:6498:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789683264.375957:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789683264.375994:0:6498:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000008a74db08) 00000020:00000080:3.0:1789683264.376015:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0F:1789683264.567580:0:6498:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789683264.567687:0:6498:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1789683264.718722:0:6498:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789683264.720620:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789683264.720633:0:6498:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789683264.720647:0:6498:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b889119 00000020:01000004:1.0:1789683264.720656:0:6498:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789683264.720662:0:6498:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789683264.720667:0:6498:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005f244228 from MGS 00000020:01000004:1.0:1789683264.720673:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789683264.720702:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000008aa8b282) 00000020:00000080:1.0:1789683264.720716:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789683264.721552:0:6498:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005f244228 from MGS, refs=2 00080000:01000000:1.0:1789683264.721560:0:6498:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789683264.721566:0:6498:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b889127 00000100:00100000:1.0:1789683264.721699:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789683264.725096:0:6498:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789683264.725112:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789683264.739069:0:6498:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789683264.739092:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789683264.751661:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683264.753699:0:6498:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789683264.753710:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789683264.755676:0:6498:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789683264.755689:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789683264.758771:0:6498:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789683264.758826:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789683264.760314:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683264.760319:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683264.760321:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683264.764712:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683264.764720:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683264.764722:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683264.765968:0:6498:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789683264.768274:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789683265.017442:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1733 MB/s 00000001:01000000:3.0:1789683265.267737:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2627 MB/s 00000001:01000000:2.0:1789683265.518189:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 342 MB/s 00000001:01000000:2.0:1789683265.777281:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 382 MB/s 00080000:10000000:3.0:1789683265.785011:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:0.0:1789683265.828948:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789683265.831270:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789683265.837470:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789683265.837527:0:6498:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789683265.837585:0:6498:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789683265.837824:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789683265.837860:0:6498:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789683265.838140:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683265.838305:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789683265.838311:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789683265.841098:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789683265.841108:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789683265.843870:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789683265.843883:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789683265.844895:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789683265.844914:0:6498:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.150@tcp' 00000020:01000004:2.0:1789683265.844915:0:6498:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789683265.844956:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.150@tcp (typ=mgc) 00000020:00000080:2.0:1789683265.844974:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.150@tcp (000000003713f343) 00000020:00000080:2.0:1789683265.844991:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789683265.845106:0:6498:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001e1b955d@MGC192.168.201.150@tcp: add connection 192.168.201.150@tcp at head 00000100:00080000:3.0:1789683265.845370:0:6517:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:2.0:1789683265.846585:0:6498:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.150@tcp-0 is initialized 00000040:01000000:2.0:1789683265.846592:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789683265.859775:0:6518:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789683265.860320:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.150@tcp (uuid e97b3c51-c653-4f2f-8e95-54cfcf70f127) 00000020:00000080:2.0:1789683265.860355:0:6498:0:(genops.c:1384:class_connect()) connect: client e97b3c51-c653-4f2f-8e95-54cfcf70f127, cookie 0xcf8485587b889135 00000100:00080000:2.0:1789683265.860367:0:6498:0:(import.c:545:import_select_connection()) MGC192.168.201.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789683265.860378:0:6498:0:(import.c:666:import_select_connection()) MGC192.168.201.150@tcp: import 000000001e1b955d using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683265.860438:0:6498:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000427927fe x1876618850074752/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789683265.860471:0:6498:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e97b3c51-c653-4f2f-8e95-54cfcf70f127->MGS 00000020:01000004:2.0:1789683265.860497:0:6498:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789683265.860502:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789683265.860515:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000054cff205) 00000020:00000080:2.0:1789683265.860526:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789683265.860782:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000427927fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3646:1876618850074752:0@lo:250: 00000100:00100000:0.0:1789683265.860879:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683265.871360:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850074752 00000100:00100000:0.0:1789683265.871375:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850074752 00000100:00100000:0.0:1789683265.871437:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683265.871444:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008bef0c5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1876618850074752:12345-0@lo:250: 00010000:00080000:0.0:1789683265.871475:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from e97b3c51-c653-4f2f-8e95-54cfcf70f127@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1789683265.871504:0:6514:0:(genops.c:1384:class_connect()) connect: client e97b3c51-c653-4f2f-8e95-54cfcf70f127, cookie 0xcf8485587b889143 00000100:00080000:0.0:1789683265.871650:0:6514:0:(import.c:65:import_set_state_nolock()) 00000000d151df93 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683265.871736:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008bef0c5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:3646:x1876618850074752:12345-0@lo:250: Request processed in 292us (10857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683265.871744:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683265.871812:0:3646:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789683265.871821:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.150@tcp: connect to target with instance 0 00000100:00080000:0.0:1789683265.871827:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789683265.871832:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789683265.871834:0:3646:0:(import.c:65:import_set_state_nolock()) 000000001e1b955d MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789683265.871837:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789683265.871844:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789683265.871849:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000427927fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3646:1876618850074752:0@lo:250: 00000100:00100000:2.0:1789683265.901226:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683265.901440:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789683265.901447:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789683265.915229:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789683265.915242:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789683265.929973:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789683265.930000:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789683265.930645:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789683265.930862:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789683265.930868:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789683265.933949:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789683265.933961:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789683266.019026:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789683266.031217:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789683266.031244:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789683266.032934:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789683266.032944:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789683266.033666:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789683266.033866:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789683266.033870:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789683266.034467:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789683266.034474:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789683266.035003:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789683266.035128:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789683266.035132:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789683266.043867:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789683266.043883:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789683266.044576:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789683266.044769:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789683266.044775:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789683266.053066:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789683266.053082:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789683266.120385:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683266.120969:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789683266.120977:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789683266.131959:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789683266.131975:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789683266.134772:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789683266.134814:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789683266.136372:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789683266.136475:0:6498:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789683266.136482:0:6498:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789683266.136583:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789683266.136616:0:6498:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.150@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789683266.136620:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789683266.136622:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789683266.136623:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683266.136624:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683266.136625:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683266.136626:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683266.136627:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683266.136628:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789683266.136630:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789683266.136631:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789683266.136637:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683266.136638:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789683266.136640:0:6498:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789683266.136642:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789683266.136643:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789683266.136644:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683266.136644:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683266.136645:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683266.136646:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683266.136647:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683266.136648:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789683266.136648:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789683266.136649:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789683266.136650:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683266.136651:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789683266.136701:0:6498:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789683266.136717:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d33056a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850074880:0@lo:253: 00000100:00100000:0.0:1789683266.136810:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683266.136850:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000166f61b2 going to sleep for 11 seconds 00000100:00100000:2.0:1789683266.136920:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850074880 00000100:00100000:2.0:1789683266.136928:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850074880 00000100:00100000:2.0:1789683266.136966:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789683266.136973:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a86e374c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:6498:x1876618850074880:12345-0@lo:253: 20000000:01000000:2.0:1789683266.137013:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789683266.137016:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789683266.139491:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789683266.139557:0:6516:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789683266.139876:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789683266.143673:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789683266.144925:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789683266.144930:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789683266.144935:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789683266.144938:0:6516:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789683266.144949:0:6516:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789683266.145132:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683266.145350:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789683266.145363:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789683266.145381:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789683266.145396:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789683266.145409:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789683266.145461:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789683266.145469:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789683266.145482:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789683266.145487:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789683266.145508:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789683266.145514:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789683266.145526:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789683266.145541:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789683266.145567:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789683266.145572:0:6516:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789683266.145579:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683266.145665:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789683266.145675:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789683266.145690:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789683266.145705:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789683266.145718:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789683266.145725:0:6516:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789683266.145749:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789683266.145757:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789683266.145770:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789683266.145836:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789683266.145857:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789683266.145866:0:6516:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789683266.145890:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789683266.145897:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789683266.145910:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789683266.145925:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789683266.145985:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789683266.146009:0:6516:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789683266.146016:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789683266.149102:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1789683266.150512:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1789683266.150543:0:6516:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.150@tcp for mdt 20000000:01000000:0.0:1789683266.150545:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:0.0:1789683266.150562:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1789683266.150569:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789683266.150583:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1789683266.150604:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:0.0:1789683266.150620:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1789683266.150629:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789683266.150641:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1789683266.150658:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1789683266.150701:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789683266.150705:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789683266.150708:0:6516:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789683266.150771:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789683266.150775:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789683266.155131:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789683266.155422:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789683266.155452:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789683266.155482:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1789683266.155493:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789683266.155497:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789683266.157225:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1789683266.157474:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789683266.157491:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1789683266.157499:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1789683266.157506:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789683266.157508:0:6516:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1789683266.157511:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789683266.157513:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789683266.157517:0:6516:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789683266.157521:0:6516:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789683266.158069:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1789683266.158191:0:6516:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789683266.172233:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789683266.172271:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789683266.172290:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789683266.172309:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789683266.172341:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000080a4e4f4/0xcf8485587b88914a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.172357:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000080a4e4f4/0xcf8485587b88914a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.172368:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000080a4e4f4/0xcf8485587b88914a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.172374:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000080a4e4f4/0xcf8485587b88914a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.172381:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000080a4e4f4/0xcf8485587b88914a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.172388:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000080a4e4f4/0xcf8485587b88914a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.172394:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000080a4e4f4 already unused, calling callback (00000000cc1fa116) 00010000:00010000:2.0:1789683266.172397:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000080a4e4f4/0xcf8485587b88914a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.172404:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000080a4e4f4/0xcf8485587b88914a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.172436:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000080a4e4f4/0xcf8485587b88914a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.172442:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000080a4e4f4/0xcf8485587b88914a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.172447:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000080a4e4f4/0xcf8485587b88914a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789683266.172464:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789683266.229270:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a86e374c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:6498:x1876618850074880:12345-0@lo:253: Request processed in 91905us (92096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683266.229291:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683266.234177:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d33056a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850074880:0@lo:253: 10000000:01000000:0.0:1789683266.234209:0:6498:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789683266.234213:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789683266.234215:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789683266.234216:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683266.234218:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789683266.234219:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683266.234221:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683266.234222:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683266.234376:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789683266.234378:0:6498:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789683266.234379:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683266.234380:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789683266.234416:0:6498:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005f244228 from lustre-MDT0000 10000000:01000000:0.0:1789683266.234460:0:6498:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789683266.234464:0:6498:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789683266.234468:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9f0fa508b380 10000000:01000000:0.0:1789683266.234473:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789683266.234483:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f0fa508b380 from 1 10000000:01000000:0.0:1789683266.234486:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789683266.234537:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b889151 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.234549:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b889151 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.234558:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b889151 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683266.234579:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d33056a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850075008:0@lo:101: 00000100:00100000:0.0:1789683266.234660:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683266.234868:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000002982d972 going to sleep for 11 seconds 00000100:00100000:3.0:1789683266.235549:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850075008 00000100:00100000:3.0:1789683266.235561:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850075008 00000100:00100000:3.0:1789683266.235671:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683266.235682:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000076fdcf0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:6498:x1876618850075008:12345-0@lo:101: 00010000:00010000:3.0:1789683266.235711:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683266.235730:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005642fdb8/0xcf8485587b889158 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889151 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683266.235758:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005642fdb8/0xcf8485587b889158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889151 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683266.235830:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005642fdb8/0xcf8485587b889158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889151 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683266.235840:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005642fdb8, rc 0) 00000100:00100000:3.0:1789683266.235961:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000076fdcf0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+6:6498:x1876618850075008:12345-0@lo:101: Request processed in 281us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683266.235968:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789683266.236168:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d33056a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850075008:0@lo:101: 00010000:00010000:2.0:1789683266.236187:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b889151 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889158 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.236197:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b889151 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889158 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683266.236307:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a8793ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850075136:0@lo:501: 00000100:00100000:2.0:1789683266.236357:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683266.245106:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e689c3e going to sleep for 11 seconds 00000100:00100000:0.0:1789683266.245502:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850075136 00000100:00100000:0.0:1789683266.245516:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850075136 00000100:00100000:1.0:1789683266.245728:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683266.245738:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000262d7d94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+6:6498:x1876618850075136:12345-0@lo:501: 00000100:00100000:1.0:1789683266.246233:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000262d7d94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+6:6498:x1876618850075136:12345-0@lo:501: Request processed in 496us (9875us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789683266.246243:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789683266.246516:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a8793ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850075136:0@lo:501: 10000000:01000000:0.0:1789683266.246567:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789683266.246593:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b889151 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889158 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.246605:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b889151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889158 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683266.246625:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0f8bdba800 10000000:01000000:0.0:1789683266.246630:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789683266.246636:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f0f8bdba800 10000000:01000000:0.0:1789683266.246638:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789683266.246642:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f0f8bdba800 from 1 10000000:01000000:0.0:1789683266.246645:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789683266.246685:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000103ce8e3/0xcf8485587b88915f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.246701:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000103ce8e3/0xcf8485587b88915f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.246713:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000103ce8e3/0xcf8485587b88915f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683266.246734:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8c607aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850075264:0@lo:101: 00000100:00100000:0.0:1789683266.246779:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683266.247114:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000922fa5cf going to sleep for 11 seconds 00000100:00100000:2.0:1789683266.247199:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850075264 00000100:00100000:2.0:1789683266.247206:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850075264 00000100:00100000:2.0:1789683266.247239:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789683266.247384:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b38ceadd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+6:6498:x1876618850075264:12345-0@lo:101: 00010000:00010000:2.0:1789683266.247399:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683266.247423:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000080a4e4f4/0xcf8485587b889166 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88915f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.247448:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000080a4e4f4/0xcf8485587b889166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88915f expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.247461:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000080a4e4f4/0xcf8485587b889166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88915f expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.247470:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000080a4e4f4, rc 0) 00000100:00100000:2.0:1789683266.247520:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b38ceadd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+7:6498:x1876618850075264:12345-0@lo:101: Request processed in 274us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683266.247526:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789683266.247619:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8c607aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850075264:0@lo:101: 00010000:00010000:0.0:1789683266.247632:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000103ce8e3/0xcf8485587b88915f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889166 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.247641:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000103ce8e3/0xcf8485587b88915f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889166 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683266.247655:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789683266.247658:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000103ce8e3/0xcf8485587b88915f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889166 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.247674:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000103ce8e3/0xcf8485587b88915f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889166 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683266.247680:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789683266.247684:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789683266.247689:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f0f8bdba800 10000000:01000000:0.0:1789683266.247691:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789683266.247743:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789683266.247746:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789683266.247764:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b88916d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.247770:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b88916d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.247777:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b88916d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683266.248034:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8c607aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850075392:0@lo:101: 00000100:00100000:0.0:1789683266.248065:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683266.248085:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000922fa5cf going to sleep for 11 seconds 00000100:00100000:1.0:1789683266.248172:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850075392 00000100:00100000:1.0:1789683266.248178:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850075392 00000100:00100000:1.0:1789683266.248211:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683266.248216:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c8f2fb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+7:6498:x1876618850075392:12345-0@lo:101: 00010000:00010000:1.0:1789683266.248224:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683266.248236:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008dcabb41/0xcf8485587b889174 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88916d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683266.248403:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008dcabb41/0xcf8485587b889174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88916d expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683266.248412:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008dcabb41/0xcf8485587b889174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88916d expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683266.248418:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008dcabb41, rc 0) 00000100:00100000:1.0:1789683266.248458:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c8f2fb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+8:6498:x1876618850075392:12345-0@lo:101: Request processed in 242us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683266.248465:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789683266.248590:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8c607aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850075392:0@lo:101: 00010000:00010000:0.0:1789683266.248601:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b88916d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889174 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.248608:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b88916d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889174 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683266.248687:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8c607aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850075520:0@lo:501: 00000100:00100000:0.0:1789683266.248767:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683266.249100:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000922fa5cf going to sleep for 11 seconds 00000100:00100000:1.0:1789683266.249160:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850075520 00000100:00100000:1.0:1789683266.249166:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850075520 00000100:00100000:1.0:1789683266.249197:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683266.249202:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002600b69c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+8:6498:x1876618850075520:12345-0@lo:501: 00000100:00100000:1.0:1789683266.249659:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002600b69c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+9:6498:x1876618850075520:12345-0@lo:501: Request processed in 455us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683266.249666:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789683266.250107:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8c607aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850075520:0@lo:501: 00000100:00100000:0.0:1789683266.250153:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8c607aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850075648:0@lo:503: 00000100:00100000:0.0:1789683266.250207:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683266.252404:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000922fa5cf going to sleep for 11 seconds 00000100:00100000:2.0:1789683266.252487:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850075648 00000100:00100000:2.0:1789683266.252499:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850075648 00000100:00100000:1.0:1789683266.252673:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789683266.252682:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cd00d977 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+9:6498:x1876618850075648:12345-0@lo:503: 00000100:00100000:1.0:1789683266.253078:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cd00d977 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+9:6498:x1876618850075648:12345-0@lo:503: Request processed in 398us (2871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683266.253097:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789683266.253217:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8c607aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850075648:0@lo:503: 00000100:00100000:3.0:1789683266.254162:0:6543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bcc7536 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6543:1876618850075776:0@lo:502: 00000100:00100000:3.0:1789683266.254224:0:6543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683266.254378:0:6543:0:(client.c:2716:ptlrpc_set_wait()) set 000000000241fedb going to sleep for 11 seconds 00000100:00100000:2.0:1789683266.254455:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850075776 00000100:00100000:2.0:1789683266.254463:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850075776 00000100:00100000:0.0:1789683266.254625:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789683266.254634:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008f2d491c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+9:6543:x1876618850075776:12345-0@lo:502: 00000100:00100000:0.0:1789683266.254777:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008f2d491c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+9:6543:x1876618850075776:12345-0@lo:502: Request processed in 144us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683266.254825:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789683266.256411:0:6543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bcc7536 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6543:1876618850075776:0@lo:502: 00000020:01000000:3.0:1789683266.256467:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683266.256487:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683266.256489:0:6543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789683266.256495:0:6543:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789683266.256498:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789683266.256518:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000c865700b) 00000020:00000080:3.0:1789683266.256542:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789683266.256548:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789683266.263227:0:6543:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789683266.263245:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b889182 00000020:00000080:3.0:1789683266.264278:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789683266.264290:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683266.264860:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683266.264864:0:6543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789683266.264869:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683266.264887:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683266.264888:0:6543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789683266.264893:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789683266.264905:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000b441cf9e) 00000020:00000080:3.0:1789683266.264922:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789683266.264926:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789683266.264928:0:6543:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789683266.264930:0:6543:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789683266.264936:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789683266.265012:0:6543:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005f244228 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789683266.265495:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000041a720f5) 00000020:00000080:3.0:1789683266.265506:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789683266.265598:0:6543:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789683266.265605:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b889197 00000020:00000080:3.0:1789683266.266920:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789683266.266930:0:6543:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789683266.266936:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcf8485587b88919e 00080000:01000000:3.0:1789683266.266943:0:6543:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789683266.266947:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b8891a5 00080000:10000000:3.0:1789683266.269907:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789683266.270881:0:6543:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789683266.286233:0:6543:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1789683266.399728:0:6543:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1789683266.400073:0:6543:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789683266.403209:0:6543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789683266.403674:0:6543:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789683266.423946:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000749e86c9) 00000020:00000080:0.0:1789683266.423972:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789683266.424066:0:6543:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789683266.424074:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b8891b3 00000020:00000080:1.0:1789683266.432509:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789683266.433758:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1789683266.480041:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1789683266.501957:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1789683266.536645:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1789683266.547062:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1789683266.573853:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1789683266.597502:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcf8485587b8891ba 00000020:00000080:3.0:1789683266.599664:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789683266.599678:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683266.599685:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683266.599687:0:6543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789683266.599690:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683266.599694:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683266.599694:0:6543:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789683266.599697:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789683266.599699:0:6543:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789683266.599702:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683266.599727:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683266.599728:0:6543:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789683266.599740:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683266.599745:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683266.599746:0:6543:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789683266.599749:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789683266.599844:0:6543:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1789683266.599915:0:6543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bcc7536 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6543:1876618850075904:0@lo:502: 00000100:00100000:3.0:1789683266.600010:0:6543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683266.600064:0:6543:0:(client.c:2716:ptlrpc_set_wait()) set 000000000241fedb going to sleep for 11 seconds 00000100:00100000:0.0:1789683266.604103:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850075904 00000100:00100000:0.0:1789683266.604286:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850075904 00000100:00100000:0.0:1789683266.604389:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789683266.604398:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b22f2c30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+9:6543:x1876618850075904:12345-0@lo:502: 00000100:00100000:0.0:1789683266.604575:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b22f2c30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+9:6543:x1876618850075904:12345-0@lo:502: Request processed in 178us (4565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683266.604583:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789683266.604679:0:6543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bcc7536 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6543:1876618850075904:0@lo:502: 00000020:01000000:3.0:1789683266.604712:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683266.604719:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683266.604722:0:6543:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1789683266.604726:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789683266.608041:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789683266.608080:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789683266.608107:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b88916d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889174 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.608136:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b88916d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889174 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683266.608144:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0f8bdba800 from 1 10000000:01000000:2.0:1789683266.608147:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789683266.608189:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b8891c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.608196:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b8891c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.608230:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b8891c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683266.608252:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a0d85ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850076032:0@lo:101: 00000100:00100000:2.0:1789683266.608329:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683266.628809:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850076032 00000100:00100000:0.0:1789683266.628846:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850076032 00000100:00100000:0.0:1789683266.629108:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789683266.629129:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000048004997 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+9:6498:x1876618850076032:12345-0@lo:101: 00010000:00010000:0.0:1789683266.629147:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683266.629175:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008a0ed8c5/0xcf8485587b8891c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8891c1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.629201:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a0ed8c5/0xcf8485587b8891c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8891c1 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.629211:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008a0ed8c5/0xcf8485587b8891c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8891c1 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.629361:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008a0ed8c5, rc 0) 00000100:00100000:0.0:1789683266.629434:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000048004997 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+10:6498:x1876618850076032:12345-0@lo:101: Request processed in 319us (21105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683266.629441:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789683266.636254:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ee77f9f going to sleep for 11 seconds 00000100:00100000:2.0:1789683266.636300:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a0d85ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850076032:0@lo:101: 00010000:00010000:2.0:1789683266.636333:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b8891c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8891c8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.636346:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b8891c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8891c8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683266.639094:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a0d85ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850076160:0@lo:256: 00000100:00100000:3.0:1789683266.643320:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683266.643395:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ee77f9f going to sleep for 11 seconds 00000100:00100000:0.0:1789683266.643459:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850076160 00000100:00100000:0.0:1789683266.643469:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850076160 00000100:00100000:0.0:1789683266.643521:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789683266.643530:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cbc1e330 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+10:6498:x1876618850076160:12345-0@lo:256: 20000000:01000000:0.0:1789683266.643554:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789683266.643560:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789683266.643643:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cbc1e330 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+10:6498:x1876618850076160:12345-0@lo:256: Request processed in 115us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683266.643650:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683266.644051:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a0d85ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850076160:0@lo:256: 10000000:01000000:3.0:1789683266.645003:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789683266.645026:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b8891c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8891c8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683266.649965:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b8891c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8891c8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683266.649978:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0f8bdba800 from 1 10000000:01000000:3.0:1789683266.649981:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789683266.650022:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000054bc69f/0xcf8485587b8891cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683266.651639:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000054bc69f/0xcf8485587b8891cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683266.651651:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000054bc69f/0xcf8485587b8891cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683266.651677:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bcc7536 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850076288:0@lo:101: 00000100:00100000:3.0:1789683266.651746:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683266.651833:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000007bfebe76 going to sleep for 11 seconds 00000100:00100000:1.0:1789683266.652212:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850076288 00000100:00100000:1.0:1789683266.652229:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850076288 00000100:00100000:1.0:1789683266.652279:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789683266.652287:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000060d58760 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+10:6498:x1876618850076288:12345-0@lo:101: 00010000:00010000:1.0:1789683266.652300:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683266.652325:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000008cc48ae/0xcf8485587b8891d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8891cf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683266.652345:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000008cc48ae/0xcf8485587b8891d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8891cf expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683266.652354:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000008cc48ae/0xcf8485587b8891d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8891cf expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683266.652361:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000008cc48ae, rc 0) 00000100:00100000:1.0:1789683266.652405:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000060d58760 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+11:6498:x1876618850076288:12345-0@lo:101: Request processed in 119us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683266.652412:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789683266.653066:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bcc7536 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850076288:0@lo:101: 00010000:00010000:3.0:1789683266.653082:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000054bc69f/0xcf8485587b8891cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8891d6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683266.653091:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000054bc69f/0xcf8485587b8891cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8891d6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683266.653286:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bcc7536 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850076416:0@lo:501: 00000100:00100000:3.0:1789683266.653329:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683266.653358:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000007bfebe76 going to sleep for 11 seconds 00000100:00100000:1.0:1789683266.657289:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850076416 00000100:00100000:1.0:1789683266.657305:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850076416 00000100:00100000:1.0:1789683266.657371:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789683266.657380:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007455c955 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+11:6498:x1876618850076416:12345-0@lo:501: 00000100:00100000:1.0:1789683266.657579:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007455c955 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+11:6498:x1876618850076416:12345-0@lo:501: Request processed in 200us (4250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683266.657587:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789683266.657817:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bcc7536 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850076416:0@lo:501: 00000100:00100000:0.0:1789683266.657878:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5bffe72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850076544:0@lo:503: 00000100:00100000:0.0:1789683266.657938:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683266.657982:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc30cf6b going to sleep for 11 seconds 00000100:00100000:1.0:1789683266.660035:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850076544 00000100:00100000:1.0:1789683266.660048:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850076544 00000100:00100000:1.0:1789683266.660091:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789683266.660097:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000060171142 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+11:6498:x1876618850076544:12345-0@lo:503: 00000040:00080000:1.0:1789683266.660164:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789683266.660676:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000060171142 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+11:6498:x1876618850076544:12345-0@lo:503: Request processed in 577us (2737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683266.660685:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789683266.661966:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5bffe72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850076544:0@lo:503: 00000040:00080000:0.0:1789683266.663831:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789683266.664103:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789683266.664139:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683266.664154:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000054bc69f/0xcf8485587b8891cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8891d6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.664166:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000054bc69f/0xcf8485587b8891cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8891d6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683266.664213:0:6498:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789683266.664225:0:6498:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0f8bdba800 10000000:01000000:2.0:1789683266.664228:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0f8bdba800 10000000:01000000:2.0:1789683266.664232:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789683266.664237:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0f8bdba800 from 1 10000000:01000000:2.0:1789683266.664250:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789683266.664280:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8891dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.664287:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8891dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.664297:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8891dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683266.664327:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009cdc15c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850076672:0@lo:101: 00000100:00100000:2.0:1789683266.664388:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683266.664439:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e689c3e going to sleep for 11 seconds 00000100:00100000:0.0:1789683266.665074:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850076672 00000100:00100000:0.0:1789683266.665083:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850076672 00000100:00100000:0.0:1789683266.665230:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789683266.665240:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000606d4dcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+11:6498:x1876618850076672:12345-0@lo:101: 00010000:00010000:0.0:1789683266.665254:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683266.665266:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000db80eb99/0xcf8485587b8891e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8891dd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.665288:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db80eb99/0xcf8485587b8891e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8891dd expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.665299:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000db80eb99/0xcf8485587b8891e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8891dd expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.665306:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000db80eb99, rc 0) 00000100:00100000:0.0:1789683266.665366:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000606d4dcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:6498:x1876618850076672:12345-0@lo:101: Request processed in 128us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683266.665373:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789683266.665466:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009cdc15c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850076672:0@lo:101: 00010000:00010000:2.0:1789683266.665480:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8891dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8891e4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.665489:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8891dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8891e4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683266.665542:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009cdc15c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850076800:0@lo:501: 00000100:00100000:2.0:1789683266.665567:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683266.690159:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e689c3e going to sleep for 11 seconds 00000100:00100000:3.0:1789683266.707017:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850076800 00000100:00100000:3.0:1789683266.707034:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850076800 00000100:00100000:3.0:1789683266.707134:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789683266.707144:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000044fc54c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:6498:x1876618850076800:12345-0@lo:501: 00000100:00100000:3.0:1789683266.707341:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000044fc54c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:6498:x1876618850076800:12345-0@lo:501: Request processed in 199us (41773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683266.707349:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789683266.707612:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009cdc15c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850076800:0@lo:501: 00000100:00100000:2.0:1789683266.707663:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009cdc15c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850076928:0@lo:503: 00000100:00100000:2.0:1789683266.707709:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683266.707750:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e689c3e going to sleep for 11 seconds 00000100:00100000:3.0:1789683266.709860:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850076928 00000100:00100000:3.0:1789683266.709882:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850076928 00000100:00100000:3.0:1789683266.709924:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789683266.709932:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009c586b6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:6498:x1876618850076928:12345-0@lo:503: 00000100:00100000:3.0:1789683266.710068:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009c586b6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:6498:x1876618850076928:12345-0@lo:503: Request processed in 137us (2359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683266.710075:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789683266.710416:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009cdc15c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850076928:0@lo:503: 00000100:00100000:2.0:1789683266.712826:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009cdc15c8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6548:1876618850077056:0@lo:502: 00000100:00100000:2.0:1789683266.712909:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683266.712946:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bac01f9e going to sleep for 11 seconds 00000100:00100000:3.0:1789683266.713390:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850077056 00000100:00100000:3.0:1789683266.713398:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850077056 00000100:00100000:3.0:1789683266.713434:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683266.713442:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006198b92c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:6548:x1876618850077056:12345-0@lo:502: 00000100:00100000:3.0:1789683266.713570:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006198b92c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:6548:x1876618850077056:12345-0@lo:502: Request processed in 129us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683266.713578:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789683266.717495:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009cdc15c8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6548:1876618850077056:0@lo:502: 00000020:01000004:2.0:1789683266.717581:0:6548:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789683266.717597:0:6548:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000001af72c23) 00000020:00000080:2.0:1789683266.717617:0:6548:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789683266.717727:0:6548:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005f244228 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789683266.717732:0:6548:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005f244228 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789683266.717734:0:6548:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005f244228 4 00010000:00080000:2.0:1789683266.717761:0:6548:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000015be8016@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00010000:2.0:1789683266.730094:0:6548:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789683266.730562:0:6548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789683266.730606:0:6548:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789683266.730620:0:6548:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcf8485587b8891f2 00000100:00080000:2.0:1789683266.730630:0:6548:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789683266.730641:0:6548:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000015be8016 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683266.730687:0:6548:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009cdc15c8 x1876618850077184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789683266.730983:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009cdc15c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876618850077184:0@lo:38: 00000100:00100000:0.0:1789683266.731049:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789683266.732039:0:6548:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789683266.736883:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850077184 00000100:00100000:1.0:1789683266.736898:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850077184 00000100:00100000:1.0:1789683266.736945:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683266.736951:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d5bffe72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876618850077184:12345-0@lo:38: 00000100:00100000:2.0:1789683266.748044:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002572e76d pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6548:1876618850077312:0@lo:502: 00000100:00100000:2.0:1789683266.748148:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683266.748191:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850077312 00000100:00100000:2.0:1789683266.748198:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850077312 00000100:00100000:2.0:1789683266.748248:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789683266.748256:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c8a968eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:6548:x1876618850077312:12345-0@lo:502: 00000100:00100000:2.0:1789683266.748375:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c8a968eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:6548:x1876618850077312:12345-0@lo:502: Request processed in 120us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683266.748382:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789683266.748433:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cfd6404 going to sleep for 11 seconds 00000100:00100000:2.0:1789683266.748452:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002572e76d pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6548:1876618850077312:0@lo:502: 00000040:00080000:2.0:1789683266.748476:0:6548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1789683266.756213:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1789683266.756460:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789683266.756488:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8891dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8891e4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683266.756501:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8891dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8891e4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789683266.756561:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789683266.756564:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789683266.756565:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683266.756566:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683266.756567:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683266.756569:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683266.756570:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789683266.756572:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789683266.756573:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789683266.756578:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789683266.756579:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683266.756580:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789683266.756583:0:6498:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1789683266.756586:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789683266.756587:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789683266.756587:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683266.756588:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683266.756589:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683266.756590:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683266.756590:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789683266.756591:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789683266.756592:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789683266.756592:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789683266.756593:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683266.756594:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789683266.756622:0:6498:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789683266.756641:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000041089294 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850077440:0@lo:253: 00000100:00100000:3.0:1789683266.757478:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683266.757516:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e310546 going to sleep for 11 seconds 00000100:00100000:1.0:1789683266.758704:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d5bffe72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876618850077184:12345-0@lo:38: Request processed in 21748us (27651us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789683266.758729:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683266.758818:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850077440 00000100:00100000:1.0:1789683266.758826:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850077440 00000100:00100000:1.0:1789683266.758857:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789683266.758863:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007b0a2aab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:6498:x1876618850077440:12345-0@lo:253: 20000000:01000000:1.0:1789683266.758922:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789683266.758937:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789683266.760195:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789683266.760205:0:3646:0:(import.c:65:import_set_state_nolock()) 0000000015be8016 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683266.760210:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789683266.760213:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009cdc15c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876618850077184:0@lo:38: 20000000:01000000:1.0:1789683266.800426:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789683266.800497:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789683266.803957:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007b0a2aab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:6498:x1876618850077440:12345-0@lo:253: Request processed in 45085us (46473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683266.803972:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789683266.804123:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000041089294 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6498:1876618850077440:0@lo:253: 10000000:01000000:3.0:1789683266.804140:0:6498:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789683266.804143:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789683266.804145:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789683266.804146:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683266.804147:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683266.804148:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683266.804149:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683266.804151:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789683266.804152:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789683266.804154:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789683266.804155:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789683266.804156:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683266.804157:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789683266.804171:0:6498:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1789683266.814820:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789683266.814830:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789683266.814855:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000096048049/0xcf8485587b8891f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.814872:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008a0ed8c5/0xcf8485587b8891c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8891c1 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.814880:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000096048049/0xcf8485587b8891f9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.814921:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008a0ed8c5/0xcf8485587b8891c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b8891c1 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.814939:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008a0ed8c5/0xcf8485587b8891c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b8891c1 expref: 11 pid: 6515 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683266.814952:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002572e76d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876618850077568:0@lo:104: 00000100:00100000:2.0:1789683266.815011:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683266.815067:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cfd6404 going to sleep for 11 seconds 00000100:00100000:0.0:1789683266.815258:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850077568 00000100:00100000:0.0:1789683266.815267:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850077568 00000100:00100000:0.0:1789683266.815321:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683266.815330:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a1ceb87b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:6537:x1876618850077568:12345-0@lo:104: 00010000:00010000:0.0:1789683266.815341:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b8891c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8891c8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.815394:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789683266.815399:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a1ceb87b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:6537:x1876618850077568:12345-0@lo:104: Request processed in 72us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683266.815405:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789683266.820892:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683266.820904:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b8891c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8891c8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.820915:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d3269a81 already unused, calling callback (00000000445b8a60) 10000000:00010000:0.0:1789683266.820918:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b8891c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8891c8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.820928:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b8891c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8891c8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683266.820934:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b8891c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8891c8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683266.820939:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789683266.820995:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b8891c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8891c8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.821002:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683266.821041:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b8891c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8891c8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.821047:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b8891c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8891c8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.821065:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683266.821067:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683266.821069:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683266.821152:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a38e935d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850077696:0@lo:103: 00000100:00100000:0.0:1789683266.821214:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683266.821373:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002572e76d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876618850077568:0@lo:104: 00010000:00010000:0.0:1789683266.821391:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000096048049/0xcf8485587b8891f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789683266.823294:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1789683266.823486:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00000100:00100000:2.0:1789683266.826680:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850077696 00000100:00100000:2.0:1789683266.826696:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850077696 00010000:00010000:2.0:1789683266.826745:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008a0ed8c5/0xcf8485587b8891c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8891c1 expref: 12 pid: 6515 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683266.826825:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683266.826834:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a7c4ad8f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:3648:x1876618850077696:12345-0@lo:103: 00010000:00010000:2.0:1789683266.826849:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683266.826853:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008a0ed8c5/0xcf8485587b8891c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8891c1 expref: 12 pid: 6515 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.826864:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008a0ed8c5/0xcf8485587b8891c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b8891c1 expref: 12 pid: 6515 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.826879:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008a0ed8c5/0xcf8485587b8891c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b8891c1 expref: 12 pid: 6515 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.826895:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000096048049/0xcf8485587b8891f9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.826901:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000096048049/0xcf8485587b8891f9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789683266.826917:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012087750s 00010000:00010000:2.0:1789683266.826921:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000096048049/0xcf8485587b8891f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.826927:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000096048049/0xcf8485587b8891f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.826933:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000096048049/0xcf8485587b8891f9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.826939:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000096048049/0xcf8485587b8891f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.826950:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000096048049 already unused, calling callback (00000000cc1fa116) 00010000:00010000:2.0:1789683266.826954:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000096048049/0xcf8485587b8891f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.826960:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000096048049/0xcf8485587b8891f9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.826978:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000096048049/0xcf8485587b8891f9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.826988:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683266.827060:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a7c4ad8f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+11:3648:x1876618850077696:12345-0@lo:103: Request processed in 228us (5846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683266.827066:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683266.827108:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a38e935d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850077696:0@lo:103: 00010000:00010000:2.0:1789683266.827156:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000096048049/0xcf8485587b8891f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.827163:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000096048049/0xcf8485587b8891f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.827168:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000096048049/0xcf8485587b8891f9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789683266.827746:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1789683266.828071:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789683266.832921:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1789683266.833413:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:0.0:1789683266.853966:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1789683266.873573:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1789683266.876582:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1789683266.879920:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1789683266.880252:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1789683266.880484:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1789683266.880649:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1789683266.901391:0:6498:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1789683266.932417:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789683266.933462:0:6553:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1789683266.933468:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789683266.934952:0:6554:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789683266.948108:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789683266.955468:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789683266.955941:0:6498:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789683266.955956:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789683266.956156:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789683266.957118:0:6498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789683266.965390:0:6554:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789683266.969762:0:6498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789683266.969867:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789683266.970106:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789683266.970386:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1789683266.971125:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789683266.971267:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789683266.971430:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789683266.971569:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789683266.971709:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789683266.971913:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789683266.972065:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00000040:00080000:1.0:1789683266.974143:0:6554:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789683266.974240:0:6554:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789683266.974244:0:6554:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1789683266.979584:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789683266.980298:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789683266.980531:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789683266.987503:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789683266.988360:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789683266.988980:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789683266.989278:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789683266.989551:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789683266.990110:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789683266.992344:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789683266.993045:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789683266.993388:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789683266.993541:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789683266.995394:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789683266.995638:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789683267.001955:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789683267.002860:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789683267.003027:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789683267.003192:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789683267.003355:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789683267.003490:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789683267.003648:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789683267.003854:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789683267.003991:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789683267.004125:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789683267.008186:0:6498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1789683267.016362:0:6498:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789683267.016408:0:6498:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba834173f988 00100000:10000000:0.0:1789683267.016416:0:6498:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789683267.043246:0:6498:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789683267.043263:0:6498:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789683267.043283:0:6498:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789683267.043340:0:6498:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789683267.049999:0:6498:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789683267.050253:0:6498:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789683267.871032:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683268.908473:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683269.920653:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683270.945530:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789683271.776117:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789683271.776127:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789683271.776130:0:38:0:(import.c:65:import_set_state_nolock()) 0000000015be8016 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789683271.776146:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000015be8016 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789683271.776168:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000012a8dda5 x1876618850077952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789683271.776218:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000012a8dda5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876618850077952:0@lo:38: 00000100:00100000:0.0:1789683271.776306:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683271.776753:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da977608 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850077824:0@lo:400: 00000100:00100000:1.0:1789683271.776808:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683271.777290:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850077824 00000100:00100000:0.0:1789683271.777299:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850077824 00000100:00100000:0.0:1789683271.777341:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789683271.777348:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000098b0c3e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+11:3649:x1876618850077824:12345-0@lo:400: 00000100:00100000:0.0:1789683271.777399:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000098b0c3e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+11:3649:x1876618850077824:12345-0@lo:400: Request processed in 51us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683271.777405:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789683271.777448:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da977608 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850077824:0@lo:400: 00000100:00100000:0.0:1789683271.778383:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850077952 00000100:00100000:0.0:1789683271.778397:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850077952 00000100:00100000:0.0:1789683271.778426:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683271.778430:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000024822747 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1876618850077952:12345-0@lo:38: 00010000:00080000:0.0:1789683271.778450:0:6523:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:0.0:1789683271.778505:0:6523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcf8485587b889200 00000004:00100000:0.0:1789683271.778964:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789683271.779122:0:6523:0:(import.c:65:import_set_state_nolock()) 00000000a7ed9886 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683271.779183:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000024822747 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876618850077952:12345-0@lo:38: Request processed in 752us (2877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683271.779190:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789683271.780822:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000012a8dda5 x1876618850077952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789683271.780842:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789683271.780851:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789683271.780856:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789683271.780859:0:3646:0:(import.c:65:import_set_state_nolock()) 0000000015be8016 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789683271.780865:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000012a8dda5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876618850077952:0@lo:38: 00010000:00010000:1.0:1789683271.979930:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683272.996896:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789683273.832650:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789683273.832659:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0f8bdba800 from 3 10000000:01000000:3.0:1789683273.832664:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789683273.832710:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 000000000e12bf9d/0xcf8485587b889207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683273.832724:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 000000000e12bf9d/0xcf8485587b889207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683273.832734:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 000000000e12bf9d/0xcf8485587b889207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683273.832759:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000041089294 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850078080:0@lo:101: 00000100:00100000:3.0:1789683273.832838:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683273.832895:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 000000004f0186e8 going to sleep for 11 seconds 00000100:00100000:1.0:1789683273.832975:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850078080 00000100:00100000:1.0:1789683273.832983:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850078080 00000100:00100000:1.0:1789683273.833053:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789683273.833062:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008067a9ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+11:6518:x1876618850078080:12345-0@lo:101: 00010000:00010000:1.0:1789683273.833077:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683273.833089:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f3bf97b1/0xcf8485587b88920e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889207 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683273.833152:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f3bf97b1/0xcf8485587b88920e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889207 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683273.833164:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f3bf97b1/0xcf8485587b88920e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889207 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683273.833171:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f3bf97b1, rc 0) 00000100:00100000:1.0:1789683273.833221:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008067a9ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:6518:x1876618850078080:12345-0@lo:101: Request processed in 161us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683273.833229:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789683273.833505:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000041089294 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850078080:0@lo:101: 00010000:00010000:3.0:1789683273.833520:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 000000000e12bf9d/0xcf8485587b889207 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88920e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683273.833527:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 000000000e12bf9d/0xcf8485587b889207 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88920e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683273.833576:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000041089294 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850078208:0@lo:256: 00000100:00100000:3.0:1789683273.833606:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683273.833642:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 000000004f0186e8 going to sleep for 11 seconds 00000100:00100000:1.0:1789683273.833697:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850078208 00000100:00100000:1.0:1789683273.833702:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850078208 00000100:00100000:1.0:1789683273.833732:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789683273.833739:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b6b048df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:6518:x1876618850078208:12345-0@lo:256: 20000000:01000000:1.0:1789683273.833753:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789683273.833770:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789683273.833772:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789683273.833866:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b6b048df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:6518:x1876618850078208:12345-0@lo:256: Request processed in 127us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683273.833873:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789683273.833949:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000041089294 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850078208:0@lo:256: 10000000:01000000:3.0:1789683273.833989:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789683273.833994:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 000000000e12bf9d/0xcf8485587b889207 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88920e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683273.834002:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 000000000e12bf9d/0xcf8485587b889207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88920e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683274.039412:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789683275.102948:0:6799:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789683275.104230:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683276.392408:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683276.895164:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c7b12628 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850078464:0@lo:400: 00000100:00100000:2.0:1789683276.895245:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683276.895424:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683276.895435:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b559f15f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850078336:0@lo:400: 00000100:00100000:1.0:1789683276.895474:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683276.895530:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850078464 00000100:00100000:1.0:1789683276.895538:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850078464 00000100:00100000:1.0:1789683276.895580:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683276.895587:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000056cfed6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850078464:12345-0@lo:400: 00000100:00100000:1.0:1789683276.895647:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000056cfed6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850078464:12345-0@lo:400: Request processed in 60us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683276.895654:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789683276.895697:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c7b12628 x1876618850078464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683276.895729:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c7b12628 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850078464:0@lo:400: 00000100:00100000:2.0:1789683276.896948:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850078336 00000100:00100000:2.0:1789683276.896957:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850078336 00000100:00100000:2.0:1789683276.897250:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789683276.897259:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000ffb204d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:3649:x1876618850078336:12345-0@lo:400: 00000100:00100000:2.0:1789683276.897319:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000ffb204d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:3649:x1876618850078336:12345-0@lo:400: Request processed in 63us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683276.897326:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789683276.898009:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b559f15f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850078336:0@lo:400: 00010000:00010000:0.0:1789683277.512229:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789683277.519253:0:6852:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789683277.519450:0:6852:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789683278.701955:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683279.712184:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683280.735070:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789683281.421771:0:6953:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789683281.422005:0:6953:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789683281.769461:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683282.015147:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683282.015182:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da977608 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850078720:0@lo:400: 00000100:00100000:0.0:1789683282.015245:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683282.015316:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850078720 00000100:00100000:0.0:1789683282.015324:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850078720 00000100:00100000:0.0:1789683282.015379:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683282.015388:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c4a53509 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850078720:12345-0@lo:400: 00000100:00100000:0.0:1789683282.015439:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c4a53509 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850078720:12345-0@lo:400: Request processed in 54us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683282.015446:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789683282.015492:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000da977608 x1876618850078720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683282.015505:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da977608 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850078720:0@lo:400: 00000100:00100000:2.0:1789683282.015654:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000012a8dda5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850078592:0@lo:400: 00000100:00100000:2.0:1789683282.015700:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683282.015775:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850078592 00000100:00100000:3.0:1789683282.015780:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850078592 00000100:00100000:3.0:1789683282.015840:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789683282.015847:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e03cc43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:3648:x1876618850078592:12345-0@lo:400: 00000100:00100000:3.0:1789683282.015883:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e03cc43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:3648:x1876618850078592:12345-0@lo:400: Request processed in 37us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683282.015889:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789683282.016062:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000012a8dda5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850078592:0@lo:400: 00010000:00010000:3.0:1789683282.784177:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683283.820408:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683284.831723:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683286.047458:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683287.071605:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683287.143232:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017abd620 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850078976:0@lo:400: 00000100:00100000:1.0:1789683287.143329:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683287.143423:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850078976 00000100:00100000:1.0:1789683287.143432:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850078976 00000100:00100000:1.0:1789683287.143495:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789683287.143505:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c25f5129 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850078976:12345-0@lo:400: 00000100:00100000:1.0:1789683287.143570:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c25f5129 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850078976:12345-0@lo:400: Request processed in 66us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683287.143586:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789683287.143637:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000017abd620 x1876618850078976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683287.143654:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017abd620 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850078976:0@lo:400: 00000100:00100000:0.0:1789683287.143734:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007881e395 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850078848:0@lo:400: 00000100:00100000:0.0:1789683287.143773:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683287.145044:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850078848 00000100:00100000:1.0:1789683287.145057:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850078848 00000100:00100000:1.0:1789683287.145107:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789683287.145116:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000066059795 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:3650:x1876618850078848:12345-0@lo:400: 00000100:00100000:1.0:1789683287.145194:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000066059795 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:3650:x1876618850078848:12345-0@lo:400: Request processed in 80us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683287.145202:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789683287.145258:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007881e395 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850078848:0@lo:400: 00010000:00010000:2.0:1789683288.098346:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683289.123616:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683290.143393:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683291.166938:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683292.191501:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683292.255336:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da977608 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850079232:0@lo:400: 00000100:00100000:0.0:1789683292.255446:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683292.255754:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683292.255766:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000012a8dda5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850079104:0@lo:400: 00000100:00100000:3.0:1789683292.255852:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683292.256025:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850079232 00000100:00100000:1.0:1789683292.256035:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850079232 00000100:00100000:1.0:1789683292.256117:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683292.256128:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000820a11f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850079232:12345-0@lo:400: 00000100:00100000:1.0:1789683292.256211:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000820a11f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850079232:12345-0@lo:400: Request processed in 85us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683292.256219:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789683292.256266:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000da977608 x1876618850079232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683292.256282:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da977608 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850079232:0@lo:400: 00000100:00100000:0.0:1789683292.256746:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850079104 00000100:00100000:0.0:1789683292.256753:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850079104 00000100:00100000:0.0:1789683292.256836:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789683292.256845:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005b5b24d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:3647:x1876618850079104:12345-0@lo:400: 00000100:00100000:0.0:1789683292.256902:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005b5b24d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:3647:x1876618850079104:12345-0@lo:400: Request processed in 60us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683292.256909:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789683292.257060:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000012a8dda5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850079104:0@lo:400: 00010000:00010000:2.0:1789683293.215330:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683294.243939:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683295.271039:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683296.287461:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683297.310972:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683297.380626:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683297.380652:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017abd620 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850079488:0@lo:400: 00000100:00100000:1.0:1789683297.380844:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683297.380915:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850079488 00000100:00100000:1.0:1789683297.380923:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850079488 00000100:00100000:1.0:1789683297.380986:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789683297.380995:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c48a0cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850079488:12345-0@lo:400: 00000100:00100000:1.0:1789683297.381047:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c48a0cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850079488:12345-0@lo:400: Request processed in 54us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683297.381054:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789683297.381093:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000017abd620 x1876618850079488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683297.381107:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017abd620 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850079488:0@lo:400: 00000100:00100000:2.0:1789683297.381334:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007881e395 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850079360:0@lo:400: 00000100:00100000:2.0:1789683297.381371:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683297.382264:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850079360 00000100:00100000:1.0:1789683297.382271:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850079360 00000100:00100000:1.0:1789683297.382312:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789683297.382319:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ff14feb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:3650:x1876618850079360:12345-0@lo:400: 00000100:00100000:1.0:1789683297.382375:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ff14feb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:3650:x1876618850079360:12345-0@lo:400: Request processed in 57us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683297.382382:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789683297.382566:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007881e395 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850079360:0@lo:400: 00010000:00010000:0.0:1789683298.350141:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683299.360178:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683300.383052:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683301.411728:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683302.433034:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789683302.433434:0:7453:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789683302.433436:0:7453:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789683302.433438:0:7453:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789683302.433581:0:7453:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000cb38fdcf 00000020:01000004:1.0:1789683302.433597:0:7453:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1789683302.433608:0:7453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789683302.433620:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000028bfd914) 00000020:00000080:1.0:1789683302.434828:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00000100:00100000:3.0:1789683302.522893:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683302.522920:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f930b3e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850079616:0@lo:400: 00000100:00100000:3.0:1789683302.523003:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683302.523096:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850079616 00000100:00100000:3.0:1789683302.523106:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850079616 00000100:00100000:3.0:1789683302.523165:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789683302.523174:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004bb95a06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:3647:x1876618850079616:12345-0@lo:400: 00000100:00100000:3.0:1789683302.523227:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004bb95a06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:3647:x1876618850079616:12345-0@lo:400: Request processed in 55us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683302.523234:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789683302.523283:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f930b3e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850079616:0@lo:400: 00000100:00100000:2.0:1789683302.526930:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f5f06cfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850079744:0@lo:400: 00000100:00100000:2.0:1789683302.527003:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683302.527122:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850079744 00000100:00100000:2.0:1789683302.527130:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850079744 00000100:00100000:2.0:1789683302.527188:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789683302.527195:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000002a30558 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850079744:12345-0@lo:400: 00000100:00100000:2.0:1789683302.527250:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000002a30558 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850079744:12345-0@lo:400: Request processed in 55us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683302.527257:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789683302.527298:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f5f06cfa x1876618850079744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683302.527312:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f5f06cfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850079744:0@lo:400: 00100000:10000000:3.0:1789683302.576262:0:7453:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1789683302.576337:0:7453:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1789683302.614945:0:7453:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789683302.615380:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789683302.615392:0:7453:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789683302.615405:0:7453:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf8485587b88921c 00000020:01000004:3.0:1789683302.615412:0:7453:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789683302.615434:0:7453:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789683302.615437:0:7453:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789683302.615442:0:7453:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789683302.615470:0:7453:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789683302.615474:0:7453:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789683302.678526:0:7453:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789683302.678560:0:7453:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.150@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1789683302.678564:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789683302.678566:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789683302.678568:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683302.678569:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683302.678570:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683302.678572:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683302.678573:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683302.678574:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789683302.678576:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789683302.678577:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683302.678578:0:7453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789683302.678580:0:7453:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1789683302.678583:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789683302.678584:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789683302.678585:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683302.678586:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683302.678587:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683302.678588:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683302.678589:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683302.678590:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789683302.678590:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789683302.678591:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683302.678592:0:7453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789683302.678615:0:7453:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789683302.678630:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077e15e3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850079872:0@lo:253: 00000100:00100000:0.0:1789683302.679316:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683302.679412:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba8a9ccc going to sleep for 11 seconds 00000100:00100000:2.0:1789683302.679459:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850079872 00000100:00100000:2.0:1789683302.679468:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850079872 00000100:00100000:2.0:1789683302.679552:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789683302.679562:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000034558fa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:7453:x1876618850079872:12345-0@lo:253: 20000000:01000000:2.0:1789683302.679593:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789683302.679598:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1789683302.679602:0:6515:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1789683302.679605:0:6515:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1789683302.679653:0:6515:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1789683302.679908:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789683302.680056:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1789683302.680071:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789683302.680088:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1789683302.680102:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1789683302.680115:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1789683302.680376:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1789683302.680385:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1789683302.680400:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1789683302.680406:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1789683302.680419:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1789683302.680424:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1789683302.680435:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1789683302.680450:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1789683302.680551:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1789683302.680559:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:2.0:1789683302.680569:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1789683302.680574:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789683302.680584:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1789683302.680588:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:2.0:1789683302.680598:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1789683302.680614:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789683302.680628:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1789683302.680640:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1789683302.680649:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1789683302.680738:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1789683302.680748:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1789683302.680761:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1789683302.680777:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1789683302.681280:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1789683302.681289:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1789683302.681302:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1789683302.681320:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1789683302.681324:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1789683302.681350:0:6515:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789683302.681357:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1789683302.687837:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789683302.688115:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789683302.688159:0:6515:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.150@tcp for mdt 20000000:01000000:3.0:1789683302.688162:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:3.0:1789683302.688178:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789683302.688184:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789683302.688195:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789683302.688199:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:3.0:1789683302.688214:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789683302.688222:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1789683302.688234:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1789683302.688258:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1789683302.688309:0:6515:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1789683302.688317:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1789683302.689698:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1789683302.689988:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789683302.690013:0:6515:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.201.150@tcp for mdt 20000000:01000000:0.0:1789683302.690015:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:0.0:1789683302.690032:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789683302.690048:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789683302.690064:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789683302.690070:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:0.0:1789683302.690080:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789683302.690088:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1789683302.690100:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789683302.690114:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1789683302.690152:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789683302.690156:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789683302.690160:0:6515:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789683302.690208:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789683302.690210:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789683302.691481:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789683302.691518:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789683302.691530:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1789683302.691849:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789683302.691875:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789683302.691894:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1789683302.691908:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789683302.691911:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789683302.692402:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1789683302.692424:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1789683302.692441:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789683302.692577:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1789683302.692600:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1789683302.692722:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1789683302.692734:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789683302.692737:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789683302.693288:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789683302.693308:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789683302.693338:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789683302.694881:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789683302.694912:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789683302.694938:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789683302.695362:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789683302.695366:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789683302.695371:0:6515:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789683302.695377:0:6515:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789683302.695738:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1789683302.696096:0:6515:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789683302.707447:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789683302.707554:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e8ba7858/0xcf8485587b889223 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.707591:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005642fdb8/0xcf8485587b889158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889151 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.707598:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008dcabb41/0xcf8485587b889174 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88916d expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.707603:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000db80eb99/0xcf8485587b8891e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8891dd expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.707609:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e8ba7858/0xcf8485587b889223 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.707661:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000db80eb99/0xcf8485587b8891e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b8891dd expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.707688:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000db80eb99/0xcf8485587b8891e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b8891dd expref: 12 pid: 6515 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683302.707703:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017abd620 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876618850080000:0@lo:104: 00000100:00100000:1.0:1789683302.707768:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683302.707846:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008dcabb41/0xcf8485587b889174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88916d expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.707854:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008dcabb41/0xcf8485587b889174 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88916d expref: 12 pid: 6514 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683302.707861:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a4b4739d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876618850080128:0@lo:104: 00000100:00100000:1.0:1789683302.707882:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683302.707906:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005642fdb8/0xcf8485587b889158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b889151 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.707921:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005642fdb8/0xcf8485587b889158 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b889151 expref: 12 pid: 6515 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683302.707930:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008835aa71 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876618850080256:0@lo:104: 00000100:00100000:1.0:1789683302.707968:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683302.707979:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc383992 going to sleep for 11 seconds 00000100:00100000:3.0:1789683302.708119:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850080000 00000100:00100000:3.0:1789683302.708127:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850080000 00000100:00100000:3.0:1789683302.708183:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850080128 00000100:00100000:3.0:1789683302.708186:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850080128 00000100:00100000:3.0:1789683302.708195:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850080256 00000100:00100000:3.0:1789683302.708197:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850080256 00000100:00100000:3.0:1789683302.708208:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683302.708216:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006e0ba251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:6515:x1876618850080000:12345-0@lo:104: 00010000:00010000:3.0:1789683302.708228:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8891dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8891e4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.708293:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789683302.708298:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006e0ba251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:6515:x1876618850080000:12345-0@lo:104: Request processed in 83us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683302.708305:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683302.708322:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683302.708328:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006c2dcb5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:6515:x1876618850080128:12345-0@lo:104: 00010000:00010000:3.0:1789683302.708341:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b88916d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889174 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.708374:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789683302.708379:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006c2dcb5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:6515:x1876618850080128:12345-0@lo:104: Request processed in 53us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683302.708386:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683302.708398:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789683302.708404:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007a62b3e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:6515:x1876618850080256:12345-0@lo:104: 00010000:00010000:3.0:1789683302.708410:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b889151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889158 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.708436:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789683302.708441:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007a62b3e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:6515:x1876618850080256:12345-0@lo:104: Request processed in 39us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683302.708446:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789683302.708464:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789683302.708469:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8891dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8891e4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.708476:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000887b3c5d already unused, calling callback (00000000445b8a60) 10000000:00010000:3.0:1789683302.708479:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8891dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8891e4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.708487:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8891dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8891e4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683302.708494:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8891dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8891e4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683302.708509:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683302.708538:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8891dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8891e4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.708544:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683302.708560:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8891dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8891e4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.708566:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8891dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8891e4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.708577:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683302.708579:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b88916d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889174 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.708585:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000078413f30 already unused, calling callback (00000000445b8a60) 10000000:00010000:3.0:1789683302.708587:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b88916d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b889174 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.708593:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b88916d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b889174 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683302.708598:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b88916d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b889174 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683302.708603:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683302.708613:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b88916d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889174 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.708618:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683302.708638:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b88916d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889174 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.708645:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b88916d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889174 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.708653:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683302.708655:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b889151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889158 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.708660:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c79f4d3b already unused, calling callback (00000000445b8a60) 10000000:00010000:3.0:1789683302.708662:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b889151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b889158 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.708681:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b889151 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b889158 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683302.708687:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b889151 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b889158 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683302.708692:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683302.708703:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b889151 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889158 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.708708:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683302.708713:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b889151 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889158 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.708719:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b889151 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889158 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.708731:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683302.708738:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683302.708739:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683302.708761:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ab99285 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850080512:0@lo:103: 00000100:00100000:3.0:1789683302.708808:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683302.708828:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683302.708833:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008d61d44c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850080640:0@lo:103: 00000100:00100000:3.0:1789683302.708854:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683302.708886:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850080512 00000100:00100000:3.0:1789683302.708890:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850080512 00010000:00010000:3.0:1789683302.708908:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008dcabb41/0xcf8485587b889174 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88916d expref: 13 pid: 6514 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683302.708927:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850080640 00000100:00100000:3.0:1789683302.708930:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850080640 00010000:00010000:3.0:1789683302.708939:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005642fdb8/0xcf8485587b889158 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889151 expref: 14 pid: 6515 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683302.708950:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683302.708956:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000022e33246 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:3647:x1876618850080512:12345-0@lo:103: 00010000:00010000:3.0:1789683302.709098:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683302.709104:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008dcabb41/0xcf8485587b889174 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88916d expref: 14 pid: 6514 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.709113:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008dcabb41/0xcf8485587b889174 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88916d expref: 14 pid: 6514 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.709127:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683302.709217:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000022e33246 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:3647:x1876618850080512:12345-0@lo:103: Request processed in 261us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683302.709223:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683302.709243:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683302.709249:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000192cfa75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+13:3647:x1876618850080640:12345-0@lo:103: 00010000:00010000:3.0:1789683302.709258:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683302.709262:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005642fdb8/0xcf8485587b889158 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889151 expref: 13 pid: 6515 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.709269:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005642fdb8/0xcf8485587b889158 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b889151 expref: 13 pid: 6515 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.709279:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683302.709299:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000192cfa75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+13:3647:x1876618850080640:12345-0@lo:103: Request processed in 51us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683302.709304:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683302.709336:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008d61d44c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850080640:0@lo:103: 00000100:00100000:3.0:1789683302.709346:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ab99285 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850080512:0@lo:103: 00000100:00100000:1.0:1789683302.709508:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017abd620 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876618850080000:0@lo:104: 00010000:00010000:1.0:1789683302.709517:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008dcabb41/0xcf8485587b889174 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88916d expref: 12 pid: 6514 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683302.709527:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a4b4739d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876618850080128:0@lo:104: 00010000:00010000:1.0:1789683302.709535:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005642fdb8/0xcf8485587b889158 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b889151 expref: 11 pid: 6515 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683302.709542:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008835aa71 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1876618850080256:0@lo:104: 00010000:00010000:1.0:1789683302.709557:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e8ba7858/0xcf8485587b889223 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683302.711215:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000041089294 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850080384:0@lo:103: 00000100:00100000:0.0:1789683302.711273:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789683302.711332:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683302.711735:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850080384 00000100:00100000:1.0:1789683302.711745:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850080384 00010000:00010000:1.0:1789683302.711778:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000db80eb99/0xcf8485587b8891e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8891dd expref: 11 pid: 6515 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683302.711838:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683302.711846:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000934338c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+11:3650:x1876618850080384:12345-0@lo:103: 00010000:00010000:1.0:1789683302.711859:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683302.711863:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000db80eb99/0xcf8485587b8891e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8891dd expref: 11 pid: 6515 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.711888:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000db80eb99/0xcf8485587b8891e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b8891dd expref: 11 pid: 6515 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.711903:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000db80eb99/0xcf8485587b8891e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b8891dd expref: 11 pid: 6515 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.711918:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e8ba7858/0xcf8485587b889223 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.711925:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e8ba7858/0xcf8485587b889223 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.711939:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e8ba7858/0xcf8485587b889223 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.711945:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e8ba7858/0xcf8485587b889223 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.711951:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e8ba7858/0xcf8485587b889223 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.712089:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e8ba7858/0xcf8485587b889223 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.712095:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e8ba7858 already unused, calling callback (00000000cc1fa116) 00010000:00010000:1.0:1789683302.712098:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e8ba7858/0xcf8485587b889223 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.712105:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e8ba7858/0xcf8485587b889223 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.712132:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e8ba7858/0xcf8485587b889223 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.712205:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683302.712247:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000934338c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+10:3650:x1876618850080384:12345-0@lo:103: Request processed in 403us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683302.712255:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789683302.712280:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e8ba7858/0xcf8485587b889223 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.712287:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e8ba7858/0xcf8485587b889223 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683302.712293:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e8ba7858/0xcf8485587b889223 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789683302.712309:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789683302.712811:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000041089294 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850080384:0@lo:103: 00000100:00100000:1.0:1789683302.734807:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000034558fa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+9:7453:x1876618850079872:12345-0@lo:253: Request processed in 55214us (55459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683302.734823:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789683302.734955:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077e15e3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850079872:0@lo:253: 10000000:01000000:0.0:1789683302.734978:0:7453:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789683302.734981:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789683302.734983:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789683302.734984:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683302.734985:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1789683302.734987:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683302.734988:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683302.734989:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683302.734991:0:7453:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789683302.734992:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683302.734993:0:7453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789683302.735016:0:7453:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000cb38fdcf from lustre-MDT0001 10000000:01000000:0.0:1789683302.735044:0:7453:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789683302.735046:0:7453:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789683302.735052:0:7453:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f0fa508b380 local copy 10000000:01000000:0.0:1789683302.735055:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789683302.735087:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88922a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683302.735098:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88922a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683302.735106:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88922a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683302.735123:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077e15e3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850080768:0@lo:101: 00000100:00100000:0.0:1789683302.735195:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683302.735230:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000681891b9 going to sleep for 11 seconds 00000100:00100000:3.0:1789683302.735412:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850080768 00000100:00100000:3.0:1789683302.735420:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850080768 00000100:00100000:3.0:1789683302.735466:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789683302.735474:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000797b1eb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+9:7453:x1876618850080768:12345-0@lo:101: 00010000:00010000:3.0:1789683302.735488:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683302.735499:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000393d6551/0xcf8485587b889231 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88922a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.735525:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000393d6551/0xcf8485587b889231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88922a expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.735534:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000393d6551/0xcf8485587b889231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88922a expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.735553:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000393d6551, rc 0) 00000100:00100000:3.0:1789683302.735585:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000797b1eb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+10:7453:x1876618850080768:12345-0@lo:101: Request processed in 113us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683302.735591:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789683302.736163:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077e15e3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850080768:0@lo:101: 00010000:00010000:0.0:1789683302.736177:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88922a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcf8485587b889231 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683302.736185:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88922a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf8485587b889231 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683302.736286:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077e15e3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850080896:0@lo:501: 00000100:00100000:0.0:1789683302.736314:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683302.736343:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000681891b9 going to sleep for 11 seconds 00000100:00100000:1.0:1789683302.736351:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850080896 00000100:00100000:1.0:1789683302.736356:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850080896 00000100:00100000:1.0:1789683302.736388:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789683302.736394:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dd2c4ad5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+10:7453:x1876618850080896:12345-0@lo:501: 00000100:00100000:1.0:1789683302.736464:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dd2c4ad5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+10:7453:x1876618850080896:12345-0@lo:501: Request processed in 70us (150us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789683302.736471:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789683302.736602:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077e15e3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850080896:0@lo:501: 10000000:01000000:0.0:1789683302.736614:0:7453:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789683302.736629:0:7453:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789683302.736633:0:7453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88922a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf8485587b889231 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683302.736640:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88922a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf8485587b889231 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683302.736646:0:7453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88922a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf8485587b889231 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683302.736677:0:7453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683302.736766:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683302.736772:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88922a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcf8485587b889231 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.736779:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c79f4d3b already unused, calling callback (00000000445b8a60) 10000000:00010000:3.0:1789683302.736807:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88922a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcf8485587b889231 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.736816:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88922a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xcf8485587b889231 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683302.736821:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88922a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xcf8485587b889231 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683302.736826:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683302.736843:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88922a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf8485587b889231 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.736848:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683302.736871:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88922a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf8485587b889231 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.736877:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88922a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf8485587b889231 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.736904:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683302.736905:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683302.736906:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683302.736951:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ab99285 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850081024:0@lo:103: 00000100:00100000:2.0:1789683302.736993:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683302.737127:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850081024 00000100:00100000:3.0:1789683302.737133:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850081024 00000100:00100000:3.0:1789683302.737183:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789683302.737190:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cc418e33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+10:3649:x1876618850081024:12345-0@lo:103: 00010000:00010000:3.0:1789683302.737199:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683302.737210:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000393d6551/0xcf8485587b889231 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88922a expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.737221:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683302.737251:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cc418e33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+9:3649:x1876618850081024:12345-0@lo:103: Request processed in 61us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683302.737257:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683302.737555:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ab99285 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850081024:0@lo:103: 10000000:01000000:0.0:1789683302.737633:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0f88c59000 10000000:01000000:0.0:1789683302.737640:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789683302.737644:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9f0fa508b380 10000000:01000000:0.0:1789683302.737652:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789683302.737655:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9f0fa508b380 from 1 10000000:01000000:0.0:1789683302.737657:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789683302.737865:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b889238 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683302.737873:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b889238 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683302.737882:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b889238 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683302.737897:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077e15e3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850081152:0@lo:101: 00000100:00100000:0.0:1789683302.737927:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683302.738192:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000681891b9 going to sleep for 11 seconds 00000100:00100000:3.0:1789683302.739078:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850081152 00000100:00100000:3.0:1789683302.739087:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850081152 00000100:00100000:0.0:1789683302.739369:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789683302.739377:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ff205414 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+9:7453:x1876618850081152:12345-0@lo:101: 00010000:00010000:0.0:1789683302.739391:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683302.739405:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000db80eb99/0xcf8485587b88923f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889238 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683302.739426:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db80eb99/0xcf8485587b88923f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889238 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683302.739436:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000db80eb99/0xcf8485587b88923f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889238 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683302.739443:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000db80eb99, rc 0) 00000100:00100000:0.0:1789683302.739506:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ff205414 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+10:7453:x1876618850081152:12345-0@lo:101: Request processed in 131us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683302.739525:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789683302.739654:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077e15e3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850081152:0@lo:101: 00010000:00010000:2.0:1789683302.739945:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b889238 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88923f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683302.740256:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b889238 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88923f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683302.740280:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789683302.740293:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b889238 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88923f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683302.740311:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 0000000078413f30/0xcf8485587b889238 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88923f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683302.740322:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f0f88c59000 10000000:01000000:2.0:1789683302.740327:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789683302.740331:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f0f88c59000 from 1 10000000:01000000:2.0:1789683302.740334:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789683302.740357:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b889246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683302.740364:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b889246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683302.740371:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b889246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683302.740388:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000932be545 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850081280:0@lo:101: 00000100:00100000:2.0:1789683302.740424:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683302.740465:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032be9d0b going to sleep for 11 seconds 00000100:00100000:0.0:1789683302.740969:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850081280 00000100:00100000:0.0:1789683302.740977:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850081280 00000100:00100000:0.0:1789683302.741022:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789683302.741030:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000df5daf4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+10:7453:x1876618850081280:12345-0@lo:101: 00010000:00010000:0.0:1789683302.741040:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683302.741050:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008a0ed8c5/0xcf8485587b88924d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889246 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683302.741066:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a0ed8c5/0xcf8485587b88924d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889246 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683302.741074:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008a0ed8c5/0xcf8485587b88924d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889246 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683302.741081:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008a0ed8c5, rc 0) 00000100:00100000:0.0:1789683302.741127:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000df5daf4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+11:7453:x1876618850081280:12345-0@lo:101: Request processed in 98us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683302.741133:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789683302.743957:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000932be545 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850081280:0@lo:101: 00010000:00010000:3.0:1789683302.743998:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b889246 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88924d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.744010:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b889246 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88924d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683302.744031:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789683302.744044:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b889246 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88924d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.744072:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000d3269a81/0xcf8485587b889246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88924d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683302.744081:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789683302.744088:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789683302.744095:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f0f88c59000 10000000:01000000:3.0:1789683302.744098:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789683302.744101:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789683302.744104:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789683302.744152:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 000000005b2fc4f3/0xcf8485587b889254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.744159:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 000000005b2fc4f3/0xcf8485587b889254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.744168:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 000000005b2fc4f3/0xcf8485587b889254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683302.744188:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008d61d44c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850081408:0@lo:101: 00000100:00100000:3.0:1789683302.744246:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683302.744277:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000099ccd67d going to sleep for 11 seconds 00000100:00100000:2.0:1789683302.744460:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850081408 00000100:00100000:2.0:1789683302.744467:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850081408 00000100:00100000:2.0:1789683302.744503:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789683302.744511:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b144218f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:7453:x1876618850081408:12345-0@lo:101: 00010000:00010000:2.0:1789683302.744522:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683302.744533:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000096048049/0xcf8485587b88925b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889254 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683302.744550:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000096048049/0xcf8485587b88925b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889254 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683302.744565:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000096048049/0xcf8485587b88925b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889254 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683302.744573:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000096048049, rc 0) 00000100:00100000:2.0:1789683302.744619:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b144218f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+13:7453:x1876618850081408:12345-0@lo:101: Request processed in 108us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683302.744626:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789683302.746306:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008d61d44c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850081408:0@lo:101: 00010000:00010000:3.0:1789683302.746328:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 000000005b2fc4f3/0xcf8485587b889254 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88925b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683302.746338:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 000000005b2fc4f3/0xcf8485587b889254 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88925b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683302.746463:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008d61d44c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850081536:0@lo:501: 00000100:00100000:3.0:1789683302.746510:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683302.746548:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000099ccd67d going to sleep for 11 seconds 00000100:00100000:2.0:1789683302.746618:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850081536 00000100:00100000:2.0:1789683302.746636:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850081536 00000100:00100000:2.0:1789683302.746697:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789683302.746706:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007be10479 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:7453:x1876618850081536:12345-0@lo:501: 00000100:00100000:2.0:1789683302.746844:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007be10479 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:7453:x1876618850081536:12345-0@lo:501: Request processed in 140us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683302.746852:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789683302.747116:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008d61d44c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850081536:0@lo:501: 00000100:00100000:2.0:1789683302.747313:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a3d0cd0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850081664:0@lo:503: 00000100:00100000:2.0:1789683302.747357:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683302.747386:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000009ab20955 going to sleep for 11 seconds 00000100:00100000:1.0:1789683302.747709:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850081664 00000100:00100000:1.0:1789683302.747720:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850081664 00000100:00100000:1.0:1789683302.747757:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789683302.747764:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000060d02607 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:7453:x1876618850081664:12345-0@lo:503: 00000100:00100000:1.0:1789683302.747876:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000060d02607 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:7453:x1876618850081664:12345-0@lo:503: Request processed in 114us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683302.747884:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789683302.748346:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a3d0cd0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850081664:0@lo:503: 00000040:00080000:3.0:1789683302.748595:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789683302.750751:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000214e047a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850081792:0@lo:502: 00000100:00100000:0.0:1789683302.750946:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683302.751005:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000099ccd67d going to sleep for 11 seconds 00000100:00100000:3.0:1789683302.753279:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850081792 00000100:00100000:3.0:1789683302.753292:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850081792 00000100:00100000:3.0:1789683302.753357:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789683302.753367:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000068e6f8e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:7453:x1876618850081792:12345-0@lo:502: 00000100:00100000:3.0:1789683302.753550:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000068e6f8e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:7453:x1876618850081792:12345-0@lo:502: Request processed in 184us (2605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683302.753559:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789683302.756056:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000214e047a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850081792:0@lo:502: 00000040:00080000:0.0:1789683302.756358:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789683302.756392:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1789683302.756405:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1789683302.756418:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1789683302.756429:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1789683302.756440:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1789683302.756452:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1789683302.756479:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1789683302.756491:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1789683302.756502:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1789683302.756513:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1789683302.756542:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1789683302.756559:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1789683302.756571:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1789683302.756582:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1789683302.756592:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1789683302.756602:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1789683302.756612:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1789683302.756622:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1789683302.756646:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1789683302.756657:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1789683302.756678:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1789683302.756691:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1789683302.756722:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082bcab9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850081920:0@lo:502: 00000100:00100000:0.0:1789683302.756832:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683302.756870:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fadbb0c6 going to sleep for 11 seconds 00000100:00100000:2.0:1789683302.757283:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850081920 00000100:00100000:2.0:1789683302.757292:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850081920 00000100:00100000:2.0:1789683302.757343:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789683302.757351:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000acef90a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:7453:x1876618850081920:12345-0@lo:502: 00000100:00100000:2.0:1789683302.757464:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000acef90a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:7453:x1876618850081920:12345-0@lo:502: Request processed in 114us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683302.757472:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789683302.758180:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082bcab9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850081920:0@lo:502: 00000040:00080000:0.0:1789683302.758248:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1789683302.758260:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1789683302.761043:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683302.761058:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683302.761060:0:7465:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789683302.761067:0:7465:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789683302.761071:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789683302.761084:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000002ad4a4a2) 00000020:00000080:0.0:1789683302.761106:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1789683302.761112:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789683302.761464:0:7465:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789683302.761475:0:7465:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf8485587b889269 00000020:00000080:0.0:1789683302.761730:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789683302.761737:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683302.761740:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683302.761742:0:7465:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789683302.761745:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683302.761749:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683302.761750:0:7465:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789683302.761753:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789683302.761760:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000c6def55b) 00000020:00000080:0.0:1789683302.761770:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1789683302.761774:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789683302.761776:0:7465:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789683302.761778:0:7465:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789683302.761828:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789683302.761881:0:7465:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cb38fdcf from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789683302.761895:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000007dea8e2b) 00000020:00000080:0.0:1789683302.761903:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1789683302.762117:0:7465:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789683302.762133:0:7465:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b88927e 00000020:00000080:0.0:1789683302.762298:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789683302.762305:0:7465:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789683302.762312:0:7465:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xcf8485587b889285 00080000:01000000:0.0:1789683302.762317:0:7465:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789683302.762321:0:7465:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf8485587b88928c 00080000:10000000:0.0:1789683302.762719:0:7465:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1789683302.780433:0:7465:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1789683303.003709:0:7465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1789683303.008159:0:7465:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1789683303.012529:0:7465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789683303.018763:0:7465:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789683303.032338:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789683303.032358:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683303.032368:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683303.032371:0:7465:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789683303.032377:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683303.032384:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683303.032385:0:7465:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789683303.032387:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789683303.032393:0:7465:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:00000080:3.0:1789683303.032431:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789683303.032464:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000055ba8521) 00000020:00000080:3.0:1789683303.032500:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789683303.032512:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789683303.032604:0:7465:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789683303.032687:0:7465:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789683303.032695:0:7465:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf8485587b88929a 00010000:00080000:3.0:1789683303.032731:0:7465:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000acf4f76f@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:3.0:1789683303.035025:0:7465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1789683303.036121:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789683303.036193:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789683303.036383:0:7465:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789683303.036412:0:7465:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b8892a1 00000100:00080000:3.0:1789683303.036426:0:7465:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683303.036441:0:7465:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000acf4f76f using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683303.036493:0:7465:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006ced06bd x1876618850082048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683303.036526:0:7465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789683303.036762:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ced06bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850082048:0@lo:38: 00000020:01000000:3.0:1789683303.036863:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683303.036874:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683303.036876:0:7465:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789683303.036881:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789683303.036884:0:7465:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789683303.036887:0:7465:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789683303.036888:0:7465:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789683303.036889:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789683303.036892:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683303.036894:0:7465:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789683303.036897:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683303.036905:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683303.036907:0:7465:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789683303.036912:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789683303.036955:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008835aa71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850082176:0@lo:400: 00000100:00100000:3.0:1789683303.036957:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a4b4739d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850082304:0@lo:400: 00000100:00100000:3.0:1789683303.037231:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683303.037308:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683303.037366:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850082304 00000100:00100000:3.0:1789683303.037375:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850082304 00000100:00100000:0.0:1789683303.037432:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683303.037673:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683303.037683:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005672e2dc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850082304:12345-0@lo:400: 00000100:00100000:1.0:1789683303.037713:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850082048 00000100:00100000:1.0:1789683303.037723:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850082048 00000100:00100000:3.0:1789683303.037757:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005672e2dc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850082304:12345-0@lo:400: Request processed in 74us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683303.037766:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683303.037815:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850082176 00000100:00100000:3.0:1789683303.037821:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850082176 00000100:00100000:3.0:1789683303.037856:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789683303.037865:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000056fdcf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:3650:x1876618850082176:12345-0@lo:400: 00000100:00100000:3.0:1789683303.037911:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000056fdcf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:3650:x1876618850082176:12345-0@lo:400: Request processed in 50us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683303.037922:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789683303.037966:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008835aa71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850082176:0@lo:400: 00000100:00100000:1.0:1789683303.037967:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683303.037975:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000082bcab9f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1876618850082048:12345-0@lo:38: 00010000:00080000:3.0:1789683303.037997:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a4b4739d x1876618850082304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1789683303.038009:0:6526:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000100:00100000:3.0:1789683303.038019:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a4b4739d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850082304:0@lo:400: 00000020:00000080:1.0:1789683303.038057:0:6526:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b8892a8 00000004:00100000:1.0:1789683303.038077:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789683303.038085:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000004:01000000:3.0:1789683303.038137:0:7465:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789683303.038165:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683303.038170:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683303.038172:0:7465:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789683303.038175:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683303.038179:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683303.038181:0:7465:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789683303.038184:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789683303.038186:0:7465:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789683303.038214:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683303.038216:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683303.038217:0:7465:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789683303.038225:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:0.0:1789683303.038328:0:7453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1789683303.038378:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789683303.038415:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 000000005b2fc4f3/0xcf8485587b889254 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88925b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683303.038427:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 000000005b2fc4f3/0xcf8485587b889254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88925b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683303.038436:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0f88c59000 from 1 10000000:01000000:0.0:1789683303.038440:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789683303.038474:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000575c6ab7/0xcf8485587b8892af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683303.038481:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000575c6ab7/0xcf8485587b8892af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683303.038488:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000575c6ab7/0xcf8485587b8892af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683303.038505:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c227c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850082432:0@lo:101: 00000100:00100000:0.0:1789683303.038543:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683303.038685:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d7ddb13 going to sleep for 11 seconds 00000100:00100000:1.0:1789683303.038708:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850082432 00000100:00100000:1.0:1789683303.038715:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850082432 00000100:00100000:1.0:1789683303.038749:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789683303.038899:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009584ad5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+12:7453:x1876618850082432:12345-0@lo:101: 00010000:00010000:1.0:1789683303.038911:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683303.038925:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e8ba7858/0xcf8485587b8892b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8892af expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683303.038946:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e8ba7858/0xcf8485587b8892b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8892af expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683303.038961:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e8ba7858/0xcf8485587b8892b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8892af expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683303.038968:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e8ba7858, rc 0) 00000100:00100000:1.0:1789683303.039006:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009584ad5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+13:7453:x1876618850082432:12345-0@lo:101: Request processed in 250us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683303.039012:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789683303.039033:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c227c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850082432:0@lo:101: 00010000:00010000:0.0:1789683303.039048:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000575c6ab7/0xcf8485587b8892af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8892b6 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683303.039057:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000575c6ab7/0xcf8485587b8892af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8892b6 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683303.039989:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017abd620 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850082560:0@lo:256: 00000100:00100000:1.0:1789683303.040048:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683303.040074:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000681139e4 going to sleep for 11 seconds 00000100:00100000:3.0:1789683303.042280:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850082560 00000100:00100000:3.0:1789683303.042295:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850082560 00000100:00100000:3.0:1789683303.042357:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789683303.042367:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e27ba9fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+13:7453:x1876618850082560:12345-0@lo:256: 20000000:01000000:3.0:1789683303.042405:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789683303.042429:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789683303.042432:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789683303.043026:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e27ba9fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+13:7453:x1876618850082560:12345-0@lo:256: Request processed in 660us (2977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683303.043036:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789683303.043411:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017abd620 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850082560:0@lo:256: 10000000:01000000:1.0:1789683303.046213:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789683303.046508:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000575c6ab7/0xcf8485587b8892af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8892b6 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683303.046526:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000575c6ab7/0xcf8485587b8892af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8892b6 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683303.050132:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0f88c59000 from 1 10000000:01000000:2.0:1789683303.050158:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683303.050205:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8892bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.050218:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8892bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.050228:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8892bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683303.050252:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007032d51b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850082688:0@lo:101: 00000100:00100000:2.0:1789683303.050328:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683303.050379:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e896b4ca going to sleep for 11 seconds 00000100:00100000:1.0:1789683303.050578:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850082688 00000100:00100000:1.0:1789683303.050595:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850082688 00000100:00100000:1.0:1789683303.051039:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789683303.051052:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb60d069 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+13:7453:x1876618850082688:12345-0@lo:101: 00010000:00010000:1.0:1789683303.051073:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683303.051094:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008dcabb41/0xcf8485587b8892c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8892bd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683303.051128:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008dcabb41/0xcf8485587b8892c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8892bd expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683303.051158:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008dcabb41/0xcf8485587b8892c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8892bd expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683303.051168:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008dcabb41, rc 0) 00000100:00100000:1.0:1789683303.051344:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb60d069 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:7453:x1876618850082688:12345-0@lo:101: Request processed in 293us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683303.051354:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789683303.051726:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007032d51b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850082688:0@lo:101: 00010000:00010000:2.0:1789683303.051749:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8892bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8892c4 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.052055:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8892bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8892c4 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683303.052212:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007032d51b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850082816:0@lo:501: 00000100:00100000:2.0:1789683303.052264:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683303.052529:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e896b4ca going to sleep for 11 seconds 00000100:00100000:1.0:1789683303.052592:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850082816 00000100:00100000:1.0:1789683303.052601:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850082816 00000100:00100000:1.0:1789683303.052743:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789683303.052755:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000051c01373 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:7453:x1876618850082816:12345-0@lo:501: 00000100:00100000:1.0:1789683303.053115:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000051c01373 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:7453:x1876618850082816:12345-0@lo:501: Request processed in 363us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683303.053125:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789683303.053297:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007032d51b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850082816:0@lo:501: 00000100:00100000:3.0:1789683303.053353:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b77242c7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850082944:0@lo:503: 00000100:00100000:3.0:1789683303.055942:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683303.055992:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000320da7db going to sleep for 11 seconds 00000100:00100000:1.0:1789683303.056275:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850082944 00000100:00100000:1.0:1789683303.056291:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850082944 00000100:00100000:1.0:1789683303.056380:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789683303.056390:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000490ff17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:7453:x1876618850082944:12345-0@lo:503: 00000040:00080000:1.0:1789683303.056474:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789683303.057174:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b77242c7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850082944:0@lo:503: 00000040:00080000:0.0:1789683303.057549:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683303.057630:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1789683303.057764:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789683303.059931:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000490ff17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:7453:x1876618850082944:12345-0@lo:503: Request processed in 3530us (3983us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683303.059952:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000040:00080000:0.0:1789683303.069039:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1789683303.070045:0:7453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789683303.070092:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683303.070120:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8892bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8892c4 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.070134:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8892bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8892c4 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683303.070200:0:7453:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789683303.070204:0:7453:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0f88c59000 10000000:01000000:2.0:1789683303.070207:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0f88c59000 10000000:01000000:2.0:1789683303.070211:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789683303.070217:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0f88c59000 from 1 10000000:01000000:2.0:1789683303.070220:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789683303.070263:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 000000001dd15dc2/0xcf8485587b8892cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.070271:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 000000001dd15dc2/0xcf8485587b8892cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.070282:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 000000001dd15dc2/0xcf8485587b8892cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683303.070306:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049f80186 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850083072:0@lo:101: 00000100:00100000:2.0:1789683303.070383:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683303.070424:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067019477 going to sleep for 11 seconds 00000100:00080000:0.0:1789683303.070528:0:6526:0:(import.c:65:import_set_state_nolock()) 0000000046d89b5b : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683303.070602:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000082bcab9f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1876618850082048:12345-0@lo:38: Request processed in 32625us (33168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683303.070615:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683303.070646:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850083072 00000100:00100000:0.0:1789683303.070653:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850083072 00000100:00100000:0.0:1789683303.070696:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789683303.070703:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c3b18d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:7453:x1876618850083072:12345-0@lo:101: 00010000:00010000:0.0:1789683303.070713:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683303.070724:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005b63d5c9/0xcf8485587b8892d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8892cb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683303.070748:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005b63d5c9/0xcf8485587b8892d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8892cb expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683303.070759:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005b63d5c9/0xcf8485587b8892d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8892cb expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683303.070767:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005b63d5c9, rc 0) 00000100:00100000:0.0:1789683303.070810:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c3b18d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:7453:x1876618850083072:12345-0@lo:101: Request processed in 108us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683303.070816:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789683303.070999:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789683303.071009:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789683303.071015:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789683303.071021:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789683303.071024:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000acf4f76f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789683303.071041:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ced06bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850082048:0@lo:38: 00000100:00100000:2.0:1789683303.071778:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049f80186 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850083072:0@lo:101: 00010000:00010000:2.0:1789683303.071811:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 000000001dd15dc2/0xcf8485587b8892cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8892d2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.071822:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 000000001dd15dc2/0xcf8485587b8892cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8892d2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683303.071994:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ced06bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850083200:0@lo:501: 00000100:00100000:3.0:1789683303.072034:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683303.072062:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000320da7db going to sleep for 11 seconds 00000100:00100000:3.0:1789683303.072079:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850083200 00000100:00100000:3.0:1789683303.072084:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850083200 00000100:00100000:3.0:1789683303.072114:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789683303.072147:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c968209a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:7453:x1876618850083200:12345-0@lo:501: 00000100:00100000:3.0:1789683303.072255:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c968209a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:7453:x1876618850083200:12345-0@lo:501: Request processed in 110us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683303.072262:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789683303.073731:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ced06bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850083200:0@lo:501: 00000100:00100000:1.0:1789683303.073775:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017abd620 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850083456:0@lo:503: 00000100:00100000:3.0:1789683303.073817:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c227c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850083328:0@lo:41: 00000100:00100000:1.0:1789683303.078812:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683303.078882:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e3bdfa4 going to sleep for 11 seconds 00000100:00100000:0.0:1789683303.079497:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850083456 00000100:00100000:0.0:1789683303.079508:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850083456 00000100:00100000:0.0:1789683303.079561:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789683303.079569:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d9347546 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:7453:x1876618850083456:12345-0@lo:503: 00000100:00100000:0.0:1789683303.079714:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d9347546 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:7453:x1876618850083456:12345-0@lo:503: Request processed in 146us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683303.079727:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789683303.079801:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017abd620 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850083456:0@lo:503: 00000040:00080000:0.0:1789683303.080068:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789683303.080218:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc0dc0cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850083584:0@lo:502: 00000100:00100000:0.0:1789683303.080260:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683303.080280:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000004505d386 going to sleep for 11 seconds 00000100:00100000:0.0:1789683303.080294:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850083584 00000100:00100000:0.0:1789683303.080298:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850083584 00000100:00100000:0.0:1789683303.080319:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789683303.080324:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000071f3f5f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:7453:x1876618850083584:12345-0@lo:502: 00000100:00100000:0.0:1789683303.080412:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000071f3f5f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:7453:x1876618850083584:12345-0@lo:502: Request processed in 87us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683303.080419:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789683303.080453:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc0dc0cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850083584:0@lo:502: 00000040:00080000:0.0:1789683303.080606:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789683303.080631:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789683303.080644:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789683303.080656:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789683303.080682:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789683303.080696:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789683303.080708:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789683303.080719:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789683303.080731:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789683303.080742:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789683303.080766:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789683303.080779:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789683303.080813:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789683303.080825:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789683303.080844:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789683303.080856:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789683303.080867:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789683303.080878:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789683303.080889:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789683303.080901:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789683303.080915:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789683303.080928:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789683303.080940:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789683303.080952:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789683303.080963:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789683303.080974:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789683303.080994:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789683303.081007:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1789683303.081025:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc0dc0cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850083712:0@lo:502: 00000100:00100000:0.0:1789683303.081062:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683303.081090:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000004505d386 going to sleep for 11 seconds 00000100:00100000:0.0:1789683303.081104:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850083712 00000100:00100000:0.0:1789683303.081108:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850083712 00000100:00100000:3.0:1789683303.087149:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683303.089539:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850083328 00000100:00100000:0.0:1789683303.089553:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850083328 00000100:00100000:0.0:1789683303.089618:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683303.089626:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009c92d352 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1876618850083328:12345-0@lo:41: 00000004:00000024:0.0:1789683303.089673:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789683303.089756:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009c92d352 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1876618850083328:12345-0@lo:41: Request processed in 131us (2616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683303.089763:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683303.089821:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789683303.089830:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b7dc80bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:7453:x1876618850083712:12345-0@lo:502: 00000100:00100000:0.0:1789683303.089939:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b7dc80bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:7453:x1876618850083712:12345-0@lo:502: Request processed in 111us (8879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683303.089952:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789683303.090321:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c227c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850083328:0@lo:41: 00000100:00100000:2.0:1789683303.090591:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc0dc0cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850083712:0@lo:502: 00000040:00080000:2.0:1789683303.091110:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789683303.091133:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1789683303.091497:0:7471:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789683303.091514:0:7471:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000009fe939d7) 00000020:00000080:2.0:1789683303.091536:0:7471:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1789683303.091621:0:7471:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cb38fdcf from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789683303.091625:0:7471:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000cb38fdcf from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789683303.091627:0:7471:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000cb38fdcf 3 00010000:00080000:2.0:1789683303.091653:0:7471:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000069d0a10@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:3.0:1789683303.093934:0:7471:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1789683303.094117:0:7471:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789683303.097315:0:7471:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789683303.097333:0:7471:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xcf8485587b8892e0 00000100:00080000:3.0:1789683303.097345:0:7471:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683303.097358:0:7471:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000069d0a10 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683303.098340:0:7471:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007008c1b8 x1876618850083840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683303.098410:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007008c1b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876618850083840:0@lo:38: 00000100:00100000:1.0:1789683303.098479:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789683303.098574:0:7471:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789683303.099200:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850083840 00000100:00100000:2.0:1789683303.099210:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850083840 00000100:00100000:2.0:1789683303.099249:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789683303.099256:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000064f09cbc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1876618850083840:12345-0@lo:38: 00010000:00080000:2.0:1789683303.099279:0:6522:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:2.0:1789683303.099326:0:6522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcf8485587b8892e7 00000004:00100000:2.0:1789683303.099341:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789683303.099373:0:6522:0:(import.c:65:import_set_state_nolock()) 0000000012ef8350 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1789683303.101586:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:0.0:1789683303.114762:0:7472:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:2.0:1789683303.115173:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000064f09cbc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876618850083840:12345-0@lo:38: Request processed in 15912us (16690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683303.115187:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1789683303.115231:0:7453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789683303.115262:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789683303.115291:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 000000001dd15dc2/0xcf8485587b8892cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8892d2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.115302:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 000000001dd15dc2/0xcf8485587b8892cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8892d2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789683303.115358:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789683303.115360:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789683303.115366:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683303.115367:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683303.115368:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683303.115370:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683303.115371:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789683303.115372:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789683303.115373:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789683303.115375:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683303.115376:0:7453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789683303.115380:0:7453:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1789683303.122377:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789683303.122395:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789683303.122397:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683303.122398:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683303.122399:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683303.122402:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683303.122403:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789683303.122405:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789683303.122406:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789683303.122407:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683303.122408:0:7453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789683303.122447:0:7453:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789683303.122468:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049f80186 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850083968:0@lo:253: 00000100:00100000:2.0:1789683303.122543:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683303.123292:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000786c6227 going to sleep for 11 seconds 00010000:00080000:1.0:1789683303.123413:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007008c1b8 x1876618850083840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683303.123426:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789683303.123434:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789683303.123442:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789683303.123447:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789683303.123450:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000069d0a10 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789683303.123456:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007008c1b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876618850083840:0@lo:38: 00000100:00100000:0.0:1789683303.126981:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850083968 00000100:00100000:0.0:1789683303.126998:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850083968 00000100:00100000:1.0:1789683303.127229:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789683303.127240:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002437ca1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:7453:x1876618850083968:12345-0@lo:253: 20000000:01000000:1.0:1789683303.127278:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789683303.127293:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1789683303.132703:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1789683303.133068:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789683303.133109:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789683303.136948:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789683303.136960:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789683303.137045:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005266fd47/0xcf8485587b8892ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683303.137065:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f3bf97b1/0xcf8485587b88920e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889207 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683303.137072:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e8ba7858/0xcf8485587b8892b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8892af expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683303.137078:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005266fd47/0xcf8485587b8892ee lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683303.137150:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e8ba7858/0xcf8485587b8892b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b8892af expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683303.137164:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e8ba7858/0xcf8485587b8892b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b8892af expref: 15 pid: 6516 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683303.137179:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005af4304d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876618850084096:0@lo:104: 00000100:00100000:1.0:1789683303.137251:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683303.137319:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f3bf97b1/0xcf8485587b88920e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b889207 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683303.137328:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f3bf97b1/0xcf8485587b88920e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b889207 expref: 15 pid: 6514 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683303.137336:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003bb3e12a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876618850084224:0@lo:104: 00000100:00100000:1.0:1789683303.137356:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683303.137458:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set 000000001b1106eb going to sleep for 11 seconds 00000100:00100000:3.0:1789683303.138001:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002437ca1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:7453:x1876618850083968:12345-0@lo:253: Request processed in 10763us (15457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683303.138013:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789683303.138142:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049f80186 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7453:1876618850083968:0@lo:253: 10000000:01000000:1.0:1789683303.138155:0:7453:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789683303.138158:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789683303.138160:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789683303.138161:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789683303.138162:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789683303.138163:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789683303.138164:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789683303.138165:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789683303.138167:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789683303.138168:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789683303.138169:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789683303.138170:0:7453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789683303.138183:0:7453:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789683303.139776:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850084096 00000100:00100000:2.0:1789683303.139797:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850084096 00000100:00100000:2.0:1789683303.139838:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850084224 00000100:00100000:2.0:1789683303.139840:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850084224 00000100:00100000:2.0:1789683303.139852:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789683303.139859:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf6697f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:6537:x1876618850084096:12345-0@lo:104: 00010000:00010000:2.0:1789683303.139874:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: 00000000575c6ab7/0xcf8485587b8892af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8892b6 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.139965:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789683303.139970:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf6697f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:6537:x1876618850084096:12345-0@lo:104: Request processed in 111us (2722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683303.139977:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789683303.139991:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789683303.139996:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004ef2f6e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:6537:x1876618850084224:12345-0@lo:104: 00010000:00010000:2.0:1789683303.140002:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: 000000000e12bf9d/0xcf8485587b889207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88920e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.140030:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789683303.140034:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004ef2f6e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:6537:x1876618850084224:12345-0@lo:104: Request processed in 39us (2678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683303.140039:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789683303.140073:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005af4304d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876618850084096:0@lo:104: 00000100:00100000:2.0:1789683303.140081:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003bb3e12a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876618850084224:0@lo:104: 00010000:00010000:2.0:1789683303.140101:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005266fd47/0xcf8485587b8892ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.140118:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683303.140573:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: 00000000575c6ab7/0xcf8485587b8892af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8892b6 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.140582:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000575c6ab7 already unused, calling callback (00000000445b8a60) 10000000:00010000:2.0:1789683303.140585:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: 00000000575c6ab7/0xcf8485587b8892af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8892b6 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.140593:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: 00000000575c6ab7/0xcf8485587b8892af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8892b6 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683303.140610:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: 00000000575c6ab7/0xcf8485587b8892af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8892b6 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683303.140615:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789683303.140653:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: 00000000575c6ab7/0xcf8485587b8892af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8892b6 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.140671:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683303.140688:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: 00000000575c6ab7/0xcf8485587b8892af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8892b6 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.140694:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: 00000000575c6ab7/0xcf8485587b8892af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8892b6 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.140711:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683303.140714:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: 000000000e12bf9d/0xcf8485587b889207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88920e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.140719:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000e12bf9d already unused, calling callback (00000000445b8a60) 10000000:00010000:2.0:1789683303.140722:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: 000000000e12bf9d/0xcf8485587b889207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88920e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.140727:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: 000000000e12bf9d/0xcf8485587b889207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88920e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683303.140734:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: 000000000e12bf9d/0xcf8485587b889207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88920e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683303.140739:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789683303.140758:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: 000000000e12bf9d/0xcf8485587b889207 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88920e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.140764:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683303.140769:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: 000000000e12bf9d/0xcf8485587b889207 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88920e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.140774:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: 000000000e12bf9d/0xcf8485587b889207 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88920e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.140814:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683303.140816:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683303.140818:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683303.140824:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683303.140845:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a45c6eaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850084352:0@lo:103: 00000100:00100000:2.0:1789683303.140884:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683303.140917:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683303.140922:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018892ffc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850084480:0@lo:103: 00000100:00100000:2.0:1789683303.140943:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683303.140968:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850084352 00000100:00100000:2.0:1789683303.140972:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850084352 00010000:00010000:2.0:1789683303.140989:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e8ba7858/0xcf8485587b8892b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8892af expref: 15 pid: 6516 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683303.141008:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850084480 00000100:00100000:2.0:1789683303.141011:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850084480 00010000:00010000:2.0:1789683303.141019:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f3bf97b1/0xcf8485587b88920e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889207 expref: 16 pid: 6514 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683303.141029:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789683303.141034:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000094e70c44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:3649:x1876618850084352:12345-0@lo:103: 00010000:00010000:2.0:1789683303.141049:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683303.141053:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e8ba7858/0xcf8485587b8892b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8892af expref: 16 pid: 6516 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.141062:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e8ba7858/0xcf8485587b8892b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b8892af expref: 16 pid: 6516 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.141074:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e8ba7858/0xcf8485587b8892b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b8892af expref: 16 pid: 6516 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.141088:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683303.141113:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000094e70c44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:3649:x1876618850084352:12345-0@lo:103: Request processed in 79us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683303.141119:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789683303.142204:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789683303.142215:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000466ba367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:3649:x1876618850084480:12345-0@lo:103: 00010000:00010000:2.0:1789683303.142226:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683303.142230:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f3bf97b1/0xcf8485587b88920e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889207 expref: 14 pid: 6514 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.142241:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f3bf97b1/0xcf8485587b88920e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b889207 expref: 14 pid: 6514 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.142253:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f3bf97b1/0xcf8485587b88920e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b889207 expref: 14 pid: 6514 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.142266:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005266fd47/0xcf8485587b8892ee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.142274:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005266fd47/0xcf8485587b8892ee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789683303.142297:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012087750s 00010000:00010000:2.0:1789683303.142301:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005266fd47/0xcf8485587b8892ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.142307:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005266fd47/0xcf8485587b8892ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.142313:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005266fd47/0xcf8485587b8892ee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.142319:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005266fd47/0xcf8485587b8892ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.142325:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005266fd47 already unused, calling callback (00000000cc1fa116) 00010000:00010000:2.0:1789683303.142328:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005266fd47/0xcf8485587b8892ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.142335:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005266fd47/0xcf8485587b8892ee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1789683303.145087:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1789683303.145423:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789683303.145631:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789683303.145861:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789683303.146055:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789683303.146234:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:0.0:1789683303.146657:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005266fd47/0xcf8485587b8892ee lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683303.146681:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005266fd47/0xcf8485587b8892ee lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.146725:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005266fd47/0xcf8485587b8892ee lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.146735:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005266fd47/0xcf8485587b8892ee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683303.146755:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683303.146868:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a45c6eaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850084352:0@lo:103: 00080000:10000000:3.0:1789683303.147620:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789683303.147850:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1789683303.148052:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1789683303.148329:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1789683303.148501:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1789683303.148708:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000100:00100000:2.0:1789683303.149140:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000466ba367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+13:3649:x1876618850084480:12345-0@lo:103: Request processed in 6926us (8193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683303.149153:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789683303.149395:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018892ffc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850084480:0@lo:103: 00000040:01000000:3.0:1789683303.150699:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1789683303.151011:0:7477:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1789683303.151059:0:7477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b164dc0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7477:1876618850084608:0@lo:700: 00000040:01000000:0.0:1789683303.151252:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1789683303.151406:0:7477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683303.151453:0:7477:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c2222825 going to sleep for 11 seconds 00000100:00100000:2.0:1789683303.151542:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850084608 00000100:00100000:2.0:1789683303.151551:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850084608 00000100:00100000:2.0:1789683303.151638:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683303.151648:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aebcd801 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7477:x1876618850084608:12345-0@lo:700: 00000020:00080000:1.0:1789683303.151884:0:7476:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789683303.151888:0:7476:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789683303.152535:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789683303.152641:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789683303.153241:0:7453:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789683303.153249:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789683303.153391:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789683303.153972:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a80e03dd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876618850084736:0@lo:1000: 00000100:00100000:0.0:1789683303.154067:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1789683303.154916:0:7453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789683303.155590:0:7453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789683303.155627:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:2.0:1789683303.155840:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850084736 00000100:00100000:2.0:1789683303.155850:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850084736 00000100:00100000:2.0:1789683303.155902:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789683303.155909:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a7c4ad8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1876618850084736:12345-0@lo:1000: 00000100:00100000:2.0:1789683303.156003:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a7c4ad8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1876618850084736:12345-0@lo:1000: Request processed in 95us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683303.156010:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1789683303.156501:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789683303.156758:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789683303.157614:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789683303.157769:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789683303.157935:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789683303.158054:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789683303.158412:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789683303.158535:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789683303.158696:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789683303.159064:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789683303.159217:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789683303.159360:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789683303.159510:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789683303.159632:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00000100:00100000:1.0:1789683303.159770:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f4f3d920 going to sleep for 11 seconds 00000100:00100000:1.0:1789683303.159875:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a80e03dd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876618850084736:0@lo:1000: 00000040:01000000:1.0:1789683303.159935:0:7478:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1789683303.159986:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ad51790 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876618850084864:0@lo:700: 00000100:00100000:1.0:1789683303.160064:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683303.160095:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ddac1725 going to sleep for 11 seconds 00000100:00100000:2.0:1789683303.160250:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850084864 00000100:00100000:2.0:1789683303.160259:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850084864 00000100:00100000:2.0:1789683303.160317:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683303.160326:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000024efa63a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7478:x1876618850084864:12345-0@lo:700: 00000100:00100000:2.0:1789683303.160390:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000024efa63a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7478:x1876618850084864:12345-0@lo:700: Request processed in 66us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683303.160397:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683303.160432:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ad51790 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876618850084864:0@lo:700: 00000100:00100000:2.0:1789683303.160481:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cc418e33 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7478:1876618850084992:0@lo:900: 00000100:00100000:2.0:1789683303.160508:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683303.160536:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850084992 00000100:00100000:2.0:1789683303.160540:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850084992 00000100:00100000:2.0:1789683303.160566:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683303.160572:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000094e70c44 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7478:x1876618850084992:12345-0@lo:900: 00000100:00100000:2.0:1789683303.160604:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000094e70c44 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7478:x1876618850084992:12345-0@lo:900: Request processed in 33us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683303.160622:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683303.160648:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076d28f44 going to sleep for 11 seconds 00010000:00080000:2.0:1789683303.160676:0:7478:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cc418e33 x1876618850084992/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789683319 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683303.160686:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cc418e33 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7478:1876618850084992:0@lo:900: 00000100:00100000:2.0:1789683303.160764:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cc418e33 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876618850085120:0@lo:1000: 00000100:00100000:2.0:1789683303.160815:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683303.160837:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850085120 00000100:00100000:2.0:1789683303.160842:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850085120 00000100:00100000:2.0:1789683303.160866:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683303.160872:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000018892ffc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1876618850085120:12345-0@lo:1000: 00000100:00100000:2.0:1789683303.160931:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000018892ffc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1876618850085120:12345-0@lo:1000: Request processed in 59us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683303.160937:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683303.160953:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e896b4ca going to sleep for 11 seconds 00000100:00100000:2.0:1789683303.160962:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cc418e33 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876618850085120:0@lo:1000: 00000004:00080000:2.0:1789683303.160999:0:7478:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000076d28f44 with version 0 00000020:00100000:2.0:1789683303.161014:0:7478:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789683303.161019:0:7478:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000cc418e33 x1876618850085376/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789683303.161029:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cc418e33 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876618850085376:0@lo:1000: 00000100:00100000:2.0:1789683303.161051:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683303.161067:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850085376 00000100:00100000:2.0:1789683303.161070:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850085376 00000100:00100000:2.0:1789683303.161087:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789683303.161097:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a45c6eaf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1876618850085376:12345-0@lo:1000: 00100000:10000000:3.0:1789683303.161441:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00000100:00100000:2.0:1789683303.161937:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067019477 going to sleep for 11 seconds 00100000:10000000:3.0:1789683303.162338:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789683303.162508:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789683303.162653:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789683303.163013:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789683303.163336:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789683303.163464:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789683303.163603:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789683303.163755:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789683303.164043:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789683303.164269:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789683303.164411:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789683303.164938:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789683303.165064:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789683303.165272:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789683303.165407:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789683303.165540:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789683303.165716:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789683303.166018:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789683303.166228:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789683303.166419:0:7453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1789683303.178861:0:7453:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789683303.179040:0:7453:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffba8341cc3988 00100000:10000000:0.0:1789683303.179056:0:7453:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1789683303.180328:0:7453:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789683303.180365:0:7453:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789683303.180385:0:7453:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789683303.180403:0:7453:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1789683303.182996:0:7453:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789683303.183206:0:7453:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:1.0:1789683303.189267:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:1.0:1789683303.189685:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:1.0:1789683303.211075:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a45c6eaf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1876618850085376:12345-0@lo:1000: Request processed in 49966us (50011us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789683303.211098:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789683303.211538:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aebcd801 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7477:x1876618850084608:12345-0@lo:700: Request processed in 59890us (60132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683303.211556:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789683303.214559:0:7477:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000b164dc0 x1876618850084608/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789683319 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683303.214590:0:7477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b164dc0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7477:1876618850084608:0@lo:700: 40000000:02000000:1.0:1789683303.214721:0:7477:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000004:00080000:0.0:1789683303.236877:0:7478:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789683303.236890:0:7478:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789683303.236912:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cc418e33 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876618850085376:0@lo:1000: 00000100:00100000:0.0:1789683303.237012:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000934338c9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876618850085504:0@lo:1000: 00000100:00100000:0.0:1789683303.237097:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683303.238303:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ac60b161 going to sleep for 11 seconds 00000100:00100000:2.0:1789683303.238548:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850085504 00000100:00100000:2.0:1789683303.238558:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850085504 00000100:00100000:2.0:1789683303.239779:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789683303.239813:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fc0dc0cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7478:x1876618850085504:12345-0@lo:1000: 00000100:00100000:2.0:1789683303.239951:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fc0dc0cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7478:x1876618850085504:12345-0@lo:1000: Request processed in 140us (2853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683303.239959:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789683303.241396:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000934338c9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1876618850085504:0@lo:1000: 00000040:00080000:2.0:1789683303.241434:0:7478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789683303.241474:0:7478:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000002aa8b0f7 with version 1 00000004:00080000:2.0:1789683303.241494:0:7468:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000095d6e5c2 version 1 rpc_version 1 00000020:00100000:2.0:1789683303.241521:0:7468:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789683303.241529:0:7468:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000049f80186 x1876618850085760/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789683303.241549:0:7468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049f80186 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7468:1876618850085760:0@lo:1000: 00000100:00100000:2.0:1789683303.241600:0:7468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683303.241628:0:7468:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076d28f44 going to sleep for 11 seconds 00000100:00100000:2.0:1789683303.241645:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850085760 00000100:00100000:2.0:1789683303.241652:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850085760 00000100:00100000:2.0:1789683303.241702:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789683303.241708:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007032d51b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1876618850085760:12345-0@lo:1000: 00000040:00080000:2.0:1789683303.244420:0:7478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789683303.244501:0:7478:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:2.0:1789683303.245529:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1789683303.245689:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007032d51b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1876618850085760:12345-0@lo:1000: Request processed in 3978us (4086us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789683303.245710:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1789683303.245769:0:7468:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789683303.245774:0:7468:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789683303.245811:0:7468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049f80186 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7468:1876618850085760:0@lo:1000: 00000040:00080000:0.0:1789683303.258924:0:7477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683303.279047:0:7477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789683303.279313:0:7477:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789683303.279319:0:7477:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1789683303.454925:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683304.483991:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683305.513974:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683306.527146:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683307.559872:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683308.128098:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000583b764 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850086016:0@lo:400: 00000100:00100000:3.0:1789683308.128174:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683308.128250:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683308.128257:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003e72e5b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850085888:0@lo:400: 00000100:00100000:3.0:1789683308.128305:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683308.128623:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bed2894d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850086144:0@lo:400: 00000100:00100000:0.0:1789683308.128653:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683308.128674:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683308.128679:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d478fe7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850086272:0@lo:400: 00000100:00100000:0.0:1789683308.128704:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683308.128731:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850086016 00000100:00100000:0.0:1789683308.128739:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850086016 00000100:00100000:0.0:1789683308.128807:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850086272 00000100:00100000:0.0:1789683308.128811:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850086272 00000100:00100000:0.0:1789683308.128826:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789683308.128833:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000b164dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850086016:12345-0@lo:400: 00000100:00100000:0.0:1789683308.128877:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000b164dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850086016:12345-0@lo:400: Request processed in 44us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683308.128883:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789683308.128899:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789683308.128904:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f5f06cfa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850086272:12345-0@lo:400: 00000100:00100000:0.0:1789683308.128941:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f5f06cfa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850086272:12345-0@lo:400: Request processed in 28us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683308.128946:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789683308.128962:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850085888 00000100:00100000:0.0:1789683308.128965:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850085888 00000100:00100000:0.0:1789683308.128986:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789683308.128990:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000036824286 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+13:3648:x1876618850085888:12345-0@lo:400: 00000100:00100000:0.0:1789683308.129016:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000036824286 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+13:3648:x1876618850085888:12345-0@lo:400: Request processed in 26us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683308.129029:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789683308.129057:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850086144 00000100:00100000:0.0:1789683308.129060:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850086144 00000100:00100000:0.0:1789683308.129086:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789683308.129092:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000077e15e3b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850086144:12345-0@lo:400: 00000100:00100000:0.0:1789683308.129126:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000077e15e3b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850086144:12345-0@lo:400: Request processed in 35us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683308.129132:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789683308.129170:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002d478fe7 x1876618850086272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683308.129183:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d478fe7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850086272:0@lo:400: 00000100:00100000:0.0:1789683308.129192:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bed2894d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850086144:0@lo:400: 00000100:00100000:1.0:1789683308.129294:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c227c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850086400:0@lo:41: 00000100:00100000:1.0:1789683308.129323:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683308.129352:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850086400 00000100:00100000:1.0:1789683308.129356:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850086400 00000100:00100000:1.0:1789683308.129373:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789683308.129378:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002d81306a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850086400:12345-0@lo:41: 00000004:00000024:1.0:1789683308.129402:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1789683308.129438:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002d81306a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850086400:12345-0@lo:41: Request processed in 59us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683308.129443:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789683308.129471:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c227c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850086400:0@lo:41: 00000100:00100000:3.0:1789683308.130825:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003e72e5b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850085888:0@lo:400: 00010000:00080000:3.0:1789683308.130844:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000583b764 x1876618850086016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683308.130855:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000583b764 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850086016:0@lo:400: 00010000:00010000:2.0:1789683308.586074:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789683308.595733:0:7723:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1789683309.440449:0:7775:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789683309.440714:0:7775:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789683309.602192:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683310.622976:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683311.648018:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789683312.224341:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789683312.224348:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0f88c59000 from 4 10000000:01000000:0.0:1789683312.224353:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789683312.224398:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 000000006d4a9fba/0xcf8485587b8892f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683312.224409:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 000000006d4a9fba/0xcf8485587b8892f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683312.224420:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 000000006d4a9fba/0xcf8485587b8892f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683312.224442:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f930b3e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850086528:0@lo:101: 00000100:00100000:0.0:1789683312.224539:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683312.224588:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 0000000047f22d1c going to sleep for 11 seconds 00000100:00100000:3.0:1789683312.224678:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850086528 00000100:00100000:3.0:1789683312.224686:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850086528 00000100:00100000:3.0:1789683312.224737:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789683312.224745:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000071c7910e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+13:6518:x1876618850086528:12345-0@lo:101: 00010000:00010000:3.0:1789683312.224759:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683312.224774:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004d6e18e8/0xcf8485587b8892fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8892f5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683312.224812:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004d6e18e8/0xcf8485587b8892fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8892f5 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683312.224822:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004d6e18e8/0xcf8485587b8892fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8892f5 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683312.224831:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004d6e18e8, rc 0) 00000100:00100000:3.0:1789683312.224885:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000071c7910e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:6518:x1876618850086528:12345-0@lo:101: Request processed in 141us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683312.224891:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789683312.225117:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f930b3e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850086528:0@lo:101: 00010000:00010000:1.0:1789683312.225131:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 000000006d4a9fba/0xcf8485587b8892f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8892fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683312.225139:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 000000006d4a9fba/0xcf8485587b8892f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8892fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683312.225187:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7dc6eff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850086656:0@lo:256: 00000100:00100000:1.0:1789683312.225216:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683312.225244:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022e3804a going to sleep for 11 seconds 00000100:00100000:0.0:1789683312.225338:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850086656 00000100:00100000:0.0:1789683312.225344:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850086656 00000100:00100000:0.0:1789683312.225378:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789683312.225384:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000483aa7d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:6518:x1876618850086656:12345-0@lo:256: 20000000:01000000:0.0:1789683312.225397:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789683312.225413:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789683312.225416:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789683312.225508:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000483aa7d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:6518:x1876618850086656:12345-0@lo:256: Request processed in 114us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683312.225515:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789683312.225577:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7dc6eff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850086656:0@lo:256: 10000000:01000000:1.0:1789683312.225623:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789683312.225628:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 000000006d4a9fba/0xcf8485587b8892f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8892fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683312.225636:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 000000006d4a9fba/0xcf8485587b8892f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8892fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683312.225645:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789683312.225647:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0f8bdba800 from 21 10000000:01000000:1.0:1789683312.225649:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789683312.225667:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000e8ba7858/0xcf8485587b889303 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683312.225673:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000e8ba7858/0xcf8485587b889303 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683312.225680:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000e8ba7858/0xcf8485587b889303 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683312.225693:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7dc6eff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850086784:0@lo:101: 00000100:00100000:1.0:1789683312.225717:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683312.225741:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022e3804a going to sleep for 11 seconds 00000100:00100000:3.0:1789683312.225813:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850086784 00000100:00100000:3.0:1789683312.225824:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850086784 00000100:00100000:3.0:1789683312.225850:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789683312.225856:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a76b2587 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:6518:x1876618850086784:12345-0@lo:101: 00010000:00010000:3.0:1789683312.225863:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683312.225873:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000393d6551/0xcf8485587b88930a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889303 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683312.225887:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000393d6551/0xcf8485587b88930a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889303 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683312.225894:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000393d6551/0xcf8485587b88930a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889303 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683312.228256:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000393d6551, rc 0) 00000100:00100000:2.0:1789683312.228692:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a76b2587 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:6518:x1876618850086784:12345-0@lo:101: Request processed in 2834us (2971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683312.228701:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789683312.228833:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7dc6eff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850086784:0@lo:101: 00010000:00010000:3.0:1789683312.228855:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000e8ba7858/0xcf8485587b889303 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88930a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683312.228865:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000e8ba7858/0xcf8485587b889303 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88930a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683312.229200:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000583b764 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850086912:0@lo:501: 00000100:00100000:3.0:1789683312.229234:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683312.229264:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850086912 00000100:00100000:3.0:1789683312.229265:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a2cd23e going to sleep for 11 seconds 00000100:00100000:2.0:1789683312.229271:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850086912 00000100:00100000:2.0:1789683312.229311:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789683312.229320:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000699bd877 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:6518:x1876618850086912:12345-0@lo:501: 00000100:00100000:2.0:1789683312.229627:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000699bd877 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:6518:x1876618850086912:12345-0@lo:501: Request processed in 308us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683312.229634:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789683312.229808:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000583b764 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850086912:0@lo:501: 00000100:00100000:3.0:1789683312.229840:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000583b764 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850087040:0@lo:503: 00000100:00100000:3.0:1789683312.229882:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683312.229909:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a2cd23e going to sleep for 11 seconds 00000100:00100000:2.0:1789683312.232020:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850087040 00000100:00100000:2.0:1789683312.232036:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850087040 00000100:00100000:2.0:1789683312.232100:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789683312.232108:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002265cd6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:6518:x1876618850087040:12345-0@lo:503: 00000100:00100000:2.0:1789683312.232275:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002265cd6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:6518:x1876618850087040:12345-0@lo:503: Request processed in 169us (2393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683312.232283:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789683312.232686:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000583b764 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850087040:0@lo:503: 00000100:00100000:2.0:1789683312.240373:0:7866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049f80186 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7866:1876618850087168:0@lo:502: 00000100:00100000:2.0:1789683312.240600:0:7866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683312.240645:0:7866:0:(client.c:2716:ptlrpc_set_wait()) set 0000000046fe6d09 going to sleep for 11 seconds 00000100:00100000:0.0:1789683312.240663:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850087168 00000100:00100000:0.0:1789683312.240671:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850087168 00000100:00100000:0.0:1789683312.240725:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789683312.240733:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e14771c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:7866:x1876618850087168:12345-0@lo:502: 00000100:00100000:0.0:1789683312.240943:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e14771c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:7866:x1876618850087168:12345-0@lo:502: Request processed in 211us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683312.240951:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789683312.241326:0:7866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049f80186 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7866:1876618850087168:0@lo:502: 00000100:00100000:2.0:1789683312.241378:0:7866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049f80186 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7866:1876618850087296:0@lo:502: 00000100:00100000:2.0:1789683312.242660:0:7866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683312.242703:0:7866:0:(client.c:2716:ptlrpc_set_wait()) set 0000000046fe6d09 going to sleep for 11 seconds 00000100:00100000:1.0:1789683312.243264:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850087296 00000100:00100000:1.0:1789683312.243274:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850087296 00000100:00100000:1.0:1789683312.243334:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789683312.243343:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000042f3bbd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:7866:x1876618850087296:12345-0@lo:502: 00000100:00100000:1.0:1789683312.243490:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000042f3bbd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:7866:x1876618850087296:12345-0@lo:502: Request processed in 148us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683312.243508:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789683312.243821:0:7866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049f80186 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7866:1876618850087296:0@lo:502: 00000040:00080000:0.0:1789683312.243855:0:7866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789683312.244159:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789683312.244182:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789683312.244190:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000e8ba7858/0xcf8485587b889303 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88930a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683312.244201:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000e8ba7858/0xcf8485587b889303 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88930a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683312.244209:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789683312.244212:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0f8bdba800 from 4 10000000:01000000:1.0:1789683312.244214:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789683312.244247:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000f3bf97b1/0xcf8485587b889311 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683312.244254:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000f3bf97b1/0xcf8485587b889311 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683312.244262:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000f3bf97b1/0xcf8485587b889311 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683312.244279:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7dc6eff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850087424:0@lo:101: 00000100:00100000:1.0:1789683312.244315:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683312.244348:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022e3804a going to sleep for 11 seconds 00000100:00100000:2.0:1789683312.245656:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850087424 00000100:00100000:2.0:1789683312.245668:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850087424 00000100:00100000:2.0:1789683312.245720:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789683312.245729:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000de8cf026 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:6518:x1876618850087424:12345-0@lo:101: 00010000:00010000:2.0:1789683312.245744:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683312.245759:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000783ae124/0xcf8485587b889318 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889311 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683312.245801:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000783ae124/0xcf8485587b889318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889311 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683312.245812:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000783ae124/0xcf8485587b889318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889311 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683312.245821:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000783ae124, rc 0) 00000100:00100000:2.0:1789683312.245885:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000de8cf026 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850087424:12345-0@lo:101: Request processed in 158us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683312.245892:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789683312.246200:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7dc6eff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850087424:0@lo:101: 00010000:00010000:2.0:1789683312.246218:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000f3bf97b1/0xcf8485587b889311 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889318 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683312.246241:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000f3bf97b1/0xcf8485587b889311 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889318 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683312.246303:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a3d0cd0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850087552:0@lo:256: 00000100:00100000:2.0:1789683312.246622:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683312.246656:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 000000006dcf5e36 going to sleep for 11 seconds 00000100:00100000:2.0:1789683312.246677:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850087552 00000100:00100000:2.0:1789683312.246682:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850087552 00000100:00100000:2.0:1789683312.246718:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789683312.246738:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a170e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850087552:12345-0@lo:256: 20000000:01000000:2.0:1789683312.246753:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789683312.246771:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789683312.246774:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789683312.246888:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a170e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850087552:12345-0@lo:256: Request processed in 152us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683312.255108:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a3d0cd0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850087552:0@lo:256: 10000000:01000000:3.0:1789683312.255181:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789683312.255191:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000f3bf97b1/0xcf8485587b889311 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889318 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683312.255202:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000f3bf97b1/0xcf8485587b889311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889318 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683312.255212:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789683312.255214:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789683312.255217:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789683312.255249:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000a9e10a9b/0xcf8485587b88931f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683312.255256:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000a9e10a9b/0xcf8485587b88931f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683312.255263:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000a9e10a9b/0xcf8485587b88931f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683312.255280:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000583b764 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850087680:0@lo:101: 00000100:00100000:3.0:1789683312.256099:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683312.256217:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a2cd23e going to sleep for 11 seconds 00000100:00100000:2.0:1789683312.257727:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789683312.257797:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850087680 00000100:00100000:2.0:1789683312.257805:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850087680 00000100:00100000:1.0:1789683312.260420:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789683312.260438:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000001821c9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850087680:12345-0@lo:101: 00010000:00010000:1.0:1789683312.260457:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683312.260475:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005266fd47/0xcf8485587b889326 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88931f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683312.260513:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005266fd47/0xcf8485587b889326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88931f expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683312.260534:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005266fd47/0xcf8485587b889326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88931f expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683312.260542:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005266fd47, rc 0) 00000100:00100000:1.0:1789683312.260620:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000001821c9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850087680:12345-0@lo:101: Request processed in 189us (4523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683312.260627:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789683312.260688:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000583b764 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850087680:0@lo:101: 00010000:00010000:1.0:1789683312.260704:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000a9e10a9b/0xcf8485587b88931f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889326 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683312.260712:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000a9e10a9b/0xcf8485587b88931f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889326 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683312.260779:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ad51790 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850087808:0@lo:501: 00000100:00100000:1.0:1789683312.260835:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683312.260864:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b9a918f1 going to sleep for 11 seconds 00000100:00100000:1.0:1789683312.260880:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850087808 00000100:00100000:1.0:1789683312.260886:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850087808 00000100:00100000:1.0:1789683312.260934:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789683312.260940:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c50129a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850087808:12345-0@lo:501: 00000100:00100000:1.0:1789683312.262751:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c50129a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850087808:12345-0@lo:501: Request processed in 1805us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683312.262764:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789683312.264585:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ad51790 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850087808:0@lo:501: 00000100:00100000:3.0:1789683312.264658:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003e72e5b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850087936:0@lo:503: 00000100:00100000:3.0:1789683312.264732:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683312.264828:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000336f09fc going to sleep for 11 seconds 00000100:00100000:0.0:1789683312.265107:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850087936 00000100:00100000:0.0:1789683312.265115:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850087936 00000100:00100000:0.0:1789683312.265163:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789683312.265173:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008bef0c5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850087936:12345-0@lo:503: 00000100:00100000:0.0:1789683312.265428:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008bef0c5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850087936:12345-0@lo:503: Request processed in 256us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683312.265437:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789683312.265519:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003e72e5b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850087936:0@lo:503: 00000100:00100000:0.0:1789683312.276415:0:7868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000012a8dda5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7868:1876618850088064:0@lo:502: 00000100:00100000:0.0:1789683312.276535:0:7868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683312.276624:0:7868:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b5d230f going to sleep for 11 seconds 00000100:00100000:3.0:1789683312.279138:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850088064 00000100:00100000:3.0:1789683312.279153:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850088064 00000100:00100000:3.0:1789683312.279438:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789683312.279449:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a86e374c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:7868:x1876618850088064:12345-0@lo:502: 00000100:00100000:3.0:1789683312.279629:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a86e374c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:7868:x1876618850088064:12345-0@lo:502: Request processed in 183us (3096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683312.279637:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789683312.279716:0:7868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000012a8dda5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7868:1876618850088064:0@lo:502: 00000020:01000000:2.0:1789683312.279745:0:7868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683312.279756:0:7868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683312.279758:0:7868:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789683312.279762:0:7868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789683312.279765:0:7868:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:00000080:2.0:1789683312.279811:0:7868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789683312.279836:0:7868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000016e93308) 00000020:00000080:2.0:1789683312.279859:0:7868:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1789683312.279870:0:7868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789683312.279981:0:7868:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789683312.279988:0:7868:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789683312.279995:0:7868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b889334 00010000:00080000:2.0:1789683312.280023:0:7868:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000037d42711@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00010000:2.0:1789683312.281694:0:7868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1789683312.283836:0:7868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789683312.283851:0:7868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789683312.283886:0:7868:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789683312.284407:0:7868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b88933b 00000100:00080000:2.0:1789683312.284418:0:7868:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789683312.284429:0:7868:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000037d42711 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683312.284462:0:7868:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000932be545 x1876618850088192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789683312.284489:0:7868:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1789683312.284542:0:7868:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1789683312.284701:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a38e935d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850088448:0@lo:400: 00000100:00100000:0.0:1789683312.284767:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683312.284824:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683312.284829:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8c607aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850088576:0@lo:400: 00000100:00100000:0.0:1789683312.284853:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683312.284882:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850088576 00000100:00100000:0.0:1789683312.284890:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850088576 00000100:00100000:0.0:1789683312.284943:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789683312.284952:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000012a8dda5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850088576:12345-0@lo:400: 00000100:00100000:0.0:1789683312.285128:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000012a8dda5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850088576:12345-0@lo:400: Request processed in 177us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683312.285135:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789683312.285173:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f8c607aa x1876618850088576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683312.285186:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8c607aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850088576:0@lo:400: 00000100:00100000:2.0:1789683312.285272:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da977608 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850088320:0@lo:400: 00000100:00100000:2.0:1789683312.285301:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683312.285363:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850088320 00000100:00100000:0.0:1789683312.285368:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850088320 00000100:00100000:0.0:1789683312.285402:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789683312.285409:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b559f15f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850088320:12345-0@lo:400: 00000100:00100000:0.0:1789683312.285446:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b559f15f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850088320:12345-0@lo:400: Request processed in 39us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683312.285452:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789683312.285475:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000da977608 x1876618850088320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683312.285507:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da977608 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850088320:0@lo:400: 00000100:00100000:3.0:1789683312.285687:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000932be545 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850088192:0@lo:38: 00000100:00100000:3.0:1789683312.285726:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683312.286149:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850088448 00000100:00100000:0.0:1789683312.286155:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850088448 00000100:00100000:0.0:1789683312.286177:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850088192 00000100:00100000:0.0:1789683312.286179:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850088192 00000100:00100000:0.0:1789683312.286190:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789683312.286195:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006d33056a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850088448:12345-0@lo:400: 00000100:00100000:0.0:1789683312.286250:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006d33056a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850088448:12345-0@lo:400: Request processed in 54us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683312.286256:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789683312.286268:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789683312.286272:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003e72e5b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850088192:12345-0@lo:38: 00010000:00080000:0.0:1789683312.286295:0:6527:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:0.0:1789683312.286328:0:6527:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b889342 00000004:00100000:0.0:1789683312.286343:0:6527:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789683312.286348:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789683312.286456:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a38e935d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850088448:0@lo:400: 00000100:00080000:2.0:1789683312.286630:0:7874:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000c7b12628 x1876618850088704/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683312.286639:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set 00000000775ccbad going to sleep for 0 seconds 00000020:01000000:3.0:1789683312.286723:0:7868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683312.286729:0:7868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683312.286731:0:7868:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789683312.286734:0:7868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683312.286737:0:7868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683312.286739:0:7868:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789683312.286741:0:7868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789683312.286742:0:7868:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789683312.286760:0:7868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022e33246 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7868:1876618850088832:0@lo:502: 00000100:00100000:3.0:1789683312.286833:0:7868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683312.286859:0:7868:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d6acdc0a going to sleep for 11 seconds 00000100:00100000:0.0:1789683312.287129:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850088832 00000100:00100000:0.0:1789683312.287135:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850088832 00000100:00100000:0.0:1789683312.287173:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789683312.287179:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000076fdcf0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:7868:x1876618850088832:12345-0@lo:502: 00000100:00100000:0.0:1789683312.287274:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000076fdcf0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:7868:x1876618850088832:12345-0@lo:502: Request processed in 96us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683312.287280:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789683312.287386:0:7868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022e33246 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:7868:1876618850088832:0@lo:502: 00000020:01000000:3.0:1789683312.287408:0:7868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683312.287412:0:7868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683312.287414:0:7868:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789683312.287417:0:7868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1789683312.291704:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1789683312.291949:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789683312.291967:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000a9e10a9b/0xcf8485587b88931f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889326 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683312.291980:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000a9e10a9b/0xcf8485587b88931f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889326 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683312.291989:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789683312.291997:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f0fa508b380 from 1 10000000:01000000:2.0:1789683312.291999:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789683312.292034:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000cef1f3ff/0xcf8485587b889349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683312.292041:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000cef1f3ff/0xcf8485587b889349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683312.292051:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000cef1f3ff/0xcf8485587b889349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683312.292089:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002572e76d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850088960:0@lo:101: 00000100:00100000:2.0:1789683312.292149:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683312.292201:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000762cc4d1 going to sleep for 11 seconds 00000100:00100000:3.0:1789683312.292541:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850088960 00000100:00100000:3.0:1789683312.292551:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850088960 00000100:00100000:3.0:1789683312.292607:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789683312.292615:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000262d7d94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850088960:12345-0@lo:101: 00010000:00010000:3.0:1789683312.292630:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683312.292642:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004fc74a61/0xcf8485587b889350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889349 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683312.292664:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004fc74a61/0xcf8485587b889350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889349 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683312.292672:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004fc74a61/0xcf8485587b889350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889349 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683312.292679:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004fc74a61, rc 0) 00000100:00100000:3.0:1789683312.292730:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000262d7d94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850088960:12345-0@lo:101: Request processed in 116us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683312.292736:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789683312.293130:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002572e76d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850088960:0@lo:101: 00010000:00010000:2.0:1789683312.293146:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000cef1f3ff/0xcf8485587b889349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889350 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683312.293155:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000cef1f3ff/0xcf8485587b889349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889350 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683312.293233:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002572e76d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850089088:0@lo:501: 00000100:00100000:2.0:1789683312.293265:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683312.293296:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000762cc4d1 going to sleep for 11 seconds 00000100:00100000:3.0:1789683312.293344:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850089088 00000100:00100000:3.0:1789683312.293350:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850089088 00000100:00100000:3.0:1789683312.293383:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789683312.293388:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b38ceadd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850089088:12345-0@lo:501: 00000100:00100000:3.0:1789683312.293470:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b38ceadd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850089088:12345-0@lo:501: Request processed in 82us (205us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789683312.293476:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789683312.293544:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002572e76d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850089088:0@lo:501: 10000000:01000000:0.0:1789683312.293569:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789683312.293579:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000cef1f3ff/0xcf8485587b889349 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889350 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683312.293586:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000cef1f3ff/0xcf8485587b889349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889350 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789683312.306883:0:6527:0:(import.c:65:import_set_state_nolock()) 00000000c579578b : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683312.307235:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003e72e5b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876618850088192:12345-0@lo:38: Request processed in 20960us (21507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683312.307247:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789683312.307451:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789683312.307462:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789683312.307471:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789683312.307476:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789683312.307486:0:3646:0:(import.c:65:import_set_state_nolock()) 0000000037d42711 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789683312.307519:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000775ccbad): req@00000000c7b12628 x1876618850088704/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683312.307542:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000932be545 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850088192:0@lo:38: 00000100:00100000:1.0:1789683312.307651:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683312.307684:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set 00000000775ccbad going to sleep for 11 seconds 00000100:00100000:3.0:1789683312.307743:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850088704 00000100:00100000:3.0:1789683312.307750:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850088704 00000100:00100000:3.0:1789683312.307817:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683312.307826:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003bb3e12a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7874:x1876618850088704:12345-0@lo:1000: 00000100:00100000:3.0:1789683312.307907:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003bb3e12a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7874:x1876618850088704:12345-0@lo:1000: Request processed in 71us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683312.308197:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c7b12628 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7874:1876618850088704:0@lo:1000: 00000040:01000000:1.0:1789683312.308229:0:7874:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789683312.308268:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005af4304d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7874:1876618850089216:0@lo:1000: 00000100:00100000:1.0:1789683312.308298:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683312.308308:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022caf7d3 going to sleep for 11 seconds 00000100:00100000:1.0:1789683312.308323:0:6527:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789683312.308329:0:6527:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1789683312.308372:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683312.308388:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850089216 00000100:00100000:3.0:1789683312.308392:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850089216 00000100:00100000:3.0:1789683312.308409:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789683312.308415:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000017abd620 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7874:x1876618850089216:12345-0@lo:1000: 00000100:00100000:3.0:1789683312.308619:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000017abd620 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7874:x1876618850089216:12345-0@lo:1000: Request processed in 204us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683312.308626:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789683312.308764:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005af4304d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7874:1876618850089216:0@lo:1000: 00000100:00100000:1.0:1789683312.308833:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005af4304d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7874:1876618850089344:0@lo:700: 00000100:00100000:1.0:1789683312.308859:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683312.308879:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set 000000004edcc166 going to sleep for 11 seconds 00000100:00100000:0.0:1789683312.309340:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683312.309351:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da977608 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850089472:0@lo:41: 00000100:00100000:0.0:1789683312.309387:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683312.309505:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850089344 00000100:00100000:3.0:1789683312.309511:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850089344 00000100:00100000:3.0:1789683312.309552:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683312.309559:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b4739d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7874:x1876618850089344:12345-0@lo:700: 00000100:00100000:3.0:1789683312.309616:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b4739d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7874:x1876618850089344:12345-0@lo:700: Request processed in 58us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683312.309623:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683312.309639:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850089472 00000100:00100000:3.0:1789683312.309643:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850089472 00000100:00100000:3.0:1789683312.309674:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789683312.309679:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f8c607aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1876618850089472:12345-0@lo:41: 00000004:00000024:3.0:1789683312.309699:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789683312.309735:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f8c607aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1876618850089472:12345-0@lo:41: Request processed in 56us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683312.309741:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789683312.309773:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da977608 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850089472:0@lo:41: 00000100:00100000:1.0:1789683312.309860:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005af4304d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7874:1876618850089344:0@lo:700: 00000100:00100000:1.0:1789683312.310224:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005af4304d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7874:1876618850089600:0@lo:1000: 00000100:00100000:1.0:1789683312.310255:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683312.310281:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b9a918f1 going to sleep for 11 seconds 00000100:00100000:3.0:1789683312.310429:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850089600 00000100:00100000:3.0:1789683312.310435:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850089600 00000100:00100000:3.0:1789683312.310468:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789683312.310474:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008835aa71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7874:x1876618850089600:12345-0@lo:1000: 00000100:00100000:3.0:1789683312.310553:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008835aa71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7874:x1876618850089600:12345-0@lo:1000: Request processed in 79us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683312.310559:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789683312.310642:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005af4304d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7874:1876618850089600:0@lo:1000: 00000004:00080000:1.0:1789683312.310689:0:7874:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000004edcc166 with version 0 00000020:00100000:1.0:1789683312.310703:0:7874:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789683312.310709:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000005af4304d x1876618850089856/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683312.310723:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005af4304d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7874:1876618850089856:0@lo:1000: 00000100:00100000:1.0:1789683312.310747:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683312.310769:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set 0000000073123d21 going to sleep for 11 seconds 00000100:00100000:3.0:1789683312.310873:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850089856 00000100:00100000:3.0:1789683312.310878:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850089856 00000100:00100000:3.0:1789683312.311233:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789683312.311243:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007881e395 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7874:x1876618850089856:12345-0@lo:1000: 00000001:00080000:0.0:1789683312.318711:0:7455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1789683312.318726:0:7455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789683312.319209:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007881e395 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7874:x1876618850089856:12345-0@lo:1000: Request processed in 7964us (8458us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789683312.319223:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1789683312.319991:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789683312.319998:0:7874:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789683312.320014:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005af4304d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7874:1876618850089856:0@lo:1000: 00000100:00100000:0.0:1789683312.320110:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f930b3e2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7874:1876618850089984:0@lo:1000: 00000100:00100000:0.0:1789683312.320161:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683312.323591:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set 000000005406f190 going to sleep for 11 seconds 00000100:00100000:1.0:1789683312.324615:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850089984 00000100:00100000:1.0:1789683312.324628:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850089984 00000020:00000004:2.0:1789683312.328767:0:7882:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789683312.329205:0:7882:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789683312.333032:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789683312.333051:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005c227c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7874:x1876618850089984:12345-0@lo:1000: 00000100:00100000:1.0:1789683312.333202:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005c227c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7874:x1876618850089984:12345-0@lo:1000: Request processed in 153us (13040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683312.333211:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789683312.333729:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f930b3e2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7874:1876618850089984:0@lo:1000: 00000040:00080000:2.0:1789683312.333762:0:7874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789683312.333832:0:7874:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000047c59a3 with version 1 00000040:00080000:2.0:1789683312.335997:0:7874:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789683312.336073:0:7874:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789683312.336078:0:7874:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:3.0:1789683312.336433:0:7872:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000004edf51c4 version 1 rpc_version 1 00000020:00100000:3.0:1789683312.336472:0:7872:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789683312.336481:0:7872:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000022e33246 x1876618850090240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789683312.336523:0:7872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022e33246 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7872:1876618850090240:0@lo:1000: 00000100:00100000:3.0:1789683312.336596:0:7872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683312.336649:0:7872:0:(client.c:2716:ptlrpc_set_wait()) set 000000009cfa337e going to sleep for 11 seconds 00000100:00100000:3.0:1789683312.336668:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850090240 00000100:00100000:3.0:1789683312.336676:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850090240 00000100:00100000:3.0:1789683312.336713:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789683312.336721:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000192cfa75 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7872:x1876618850090240:12345-0@lo:1000: 00000001:00080000:0.0:1789683312.352124:0:7455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1789683312.352396:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000192cfa75 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7872:x1876618850090240:12345-0@lo:1000: Request processed in 15671us (15797us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789683312.352420:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1789683312.352517:0:7872:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789683312.352523:0:7872:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789683312.352541:0:7872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022e33246 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7872:1876618850090240:0@lo:1000: 00010000:00010000:2.0:1789683312.671190:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683313.249956:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683313.249981:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009cdc15c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850090368:0@lo:41: 00000100:00100000:2.0:1789683313.250059:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683313.251321:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850090368 00000100:00100000:1.0:1789683313.251335:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850090368 00000100:00100000:1.0:1789683313.251391:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789683313.251400:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003a0d85ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850090368:12345-0@lo:41: 00000004:00000024:1.0:1789683313.251439:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1789683313.251519:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003a0d85ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850090368:12345-0@lo:41: Request processed in 121us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683313.251527:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789683313.251577:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009cdc15c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850090368:0@lo:41: 00000020:00000080:2.0:1789683313.367398:0:7931:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6899b5d0 20000000:00000080:2.0:1789683313.367417:0:7931:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0fb62c4400 uarg=0000000000000000 20000000:01000000:2.0:1789683313.367459:0:7931:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789683313.367467:0:7931:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789683313.367472:0:7931:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789683313.369218:0:7931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789683313.369231:0:7931:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789683313.372144:0:7931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789683313.372380:0:7931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789683313.372410:0:7931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789683313.372423:0:7931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789683313.372437:0:7931:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789683313.372453:0:7931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bf6ad79e/0xcf8485587b889357 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683313.372471:0:7931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000008cc48ae/0xcf8485587b8891d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8891cf expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683313.372678:0:7931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008dcabb41/0xcf8485587b8892c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8892bd expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683313.372686:0:7931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bf6ad79e/0xcf8485587b889357 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683313.372740:0:7931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008dcabb41/0xcf8485587b8892c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b8892bd expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683313.372755:0:7931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008dcabb41/0xcf8485587b8892c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b8892bd expref: 17 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683313.372769:0:7931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a8793ec pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7931:1876618850090496:0@lo:104: 00000100:00100000:2.0:1789683313.372977:0:7931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789683313.373058:0:7931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000008cc48ae/0xcf8485587b8891d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b8891cf expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683313.373065:0:7931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000008cc48ae/0xcf8485587b8891d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b8891cf expref: 17 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683313.373073:0:7931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000427927fe pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7931:1876618850090624:0@lo:104: 00000100:00100000:2.0:1789683313.373090:0:7931:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a660a526 going to sleep for 11 seconds 00000100:00100000:3.0:1789683313.375233:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789683313.375269:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683313.375335:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850090496 00000100:00100000:3.0:1789683313.375343:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850090496 00000100:00100000:2.0:1789683313.375395:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850090624 00000100:00100000:2.0:1789683313.375398:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850090624 00000100:00100000:2.0:1789683313.375420:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789683313.375429:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f78ed2d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:7931:x1876618850090496:12345-0@lo:104: 00010000:00010000:2.0:1789683313.375447:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8892bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8892c4 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683313.375727:0:7931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a8793ec pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7931:1876618850090496:0@lo:104: 00010000:00010000:2.0:1789683313.375765:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789683313.375771:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f78ed2d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:7931:x1876618850090496:12345-0@lo:104: Request processed in 344us (2795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683313.375778:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789683313.375834:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789683313.375852:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007008c1b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:7931:x1876618850090624:12345-0@lo:104: 00010000:00010000:2.0:1789683313.375859:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: 00000000054bc69f/0xcf8485587b8891cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8891d6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683313.375937:0:7931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000427927fe pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7931:1876618850090624:0@lo:104: 00010000:00010000:0.0:1789683313.375967:0:7931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bf6ad79e/0xcf8485587b889357 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683313.376097:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683313.376103:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8892bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8892c4 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683313.376111:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000887b3c5d already unused, calling callback (00000000445b8a60) 10000000:00010000:1.0:1789683313.376114:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8892bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8892c4 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683313.376121:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8892bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8892c4 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683313.376127:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8892bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8892c4 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683313.376139:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789683313.376204:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8892bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8892c4 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683313.376211:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683313.376238:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8892bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8892c4 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683313.376244:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: 00000000887b3c5d/0xcf8485587b8892bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8892c4 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683313.376256:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683313.376258:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: 00000000054bc69f/0xcf8485587b8891cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8891d6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683313.376263:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000054bc69f already unused, calling callback (00000000445b8a60) 10000000:00010000:1.0:1789683313.376265:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: 00000000054bc69f/0xcf8485587b8891cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8891d6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683313.376270:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: 00000000054bc69f/0xcf8485587b8891cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8891d6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683313.376275:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: 00000000054bc69f/0xcf8485587b8891cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8891d6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683313.376280:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789683313.376317:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006e0ba251 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850090752:0@lo:103: 00000100:00100000:3.0:1789683313.376349:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683313.376392:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850090752 00000100:00100000:3.0:1789683313.376396:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850090752 00010000:00010000:3.0:1789683313.376414:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008dcabb41/0xcf8485587b8892c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8892bd expref: 18 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683313.376436:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683313.376442:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006ced06bd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:3649:x1876618850090752:12345-0@lo:103: 00010000:00010000:3.0:1789683313.376453:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683313.376457:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008dcabb41/0xcf8485587b8892c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8892bd expref: 18 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683313.376467:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008dcabb41/0xcf8485587b8892c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b8892bd expref: 18 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683313.376499:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008dcabb41/0xcf8485587b8892c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b8892bd expref: 18 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683313.376511:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683313.376539:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006ced06bd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:3649:x1876618850090752:12345-0@lo:103: Request processed in 98us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683313.376551:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683313.376578:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006e0ba251 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850090752:0@lo:103: 00010000:00010000:2.0:1789683313.376913:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789683313.376920:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007008c1b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:7931:x1876618850090624:12345-0@lo:104: Request processed in 1070us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683313.376927:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1789683313.376984:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683313.377120:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: 00000000054bc69f/0xcf8485587b8891cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8891d6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683313.377127:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683313.377150:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: 00000000054bc69f/0xcf8485587b8891cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8891d6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683313.377155:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: 00000000054bc69f/0xcf8485587b8891cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8891d6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683313.377167:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683313.377169:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683313.377170:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683313.377179:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c2dcb5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850090880:0@lo:103: 00000100:00100000:1.0:1789683313.377208:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683313.377305:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850090880 00000100:00100000:2.0:1789683313.377311:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850090880 00010000:00010000:2.0:1789683313.377326:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000008cc48ae/0xcf8485587b8891d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8891cf expref: 17 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683313.377354:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789683313.377359:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007a62b3e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:3650:x1876618850090880:12345-0@lo:103: 00010000:00010000:2.0:1789683313.377367:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683313.377370:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000008cc48ae/0xcf8485587b8891d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8891cf expref: 17 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683313.377379:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000008cc48ae/0xcf8485587b8891d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b8891cf expref: 17 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683313.377389:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000008cc48ae/0xcf8485587b8891d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b8891cf expref: 17 pid: 6516 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683313.377400:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bf6ad79e/0xcf8485587b889357 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683313.377408:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf6ad79e/0xcf8485587b889357 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683313.377430:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bf6ad79e/0xcf8485587b889357 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683313.377437:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bf6ad79e/0xcf8485587b889357 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683313.377442:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bf6ad79e/0xcf8485587b889357 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683313.377447:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bf6ad79e/0xcf8485587b889357 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683313.377453:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bf6ad79e already unused, calling callback (00000000cc1fa116) 00010000:00010000:2.0:1789683313.377455:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bf6ad79e/0xcf8485587b889357 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683313.377461:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bf6ad79e/0xcf8485587b889357 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683313.377716:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bf6ad79e/0xcf8485587b889357 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683313.377726:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683313.377760:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007a62b3e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:3650:x1876618850090880:12345-0@lo:103: Request processed in 402us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683313.377767:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789683313.377859:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c2dcb5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850090880:0@lo:103: 00010000:00010000:1.0:1789683313.377928:0:7931:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bf6ad79e/0xcf8485587b889357 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683313.377937:0:7931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bf6ad79e/0xcf8485587b889357 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683313.377943:0:7931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bf6ad79e/0xcf8485587b889357 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683313.694950:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683314.719159:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683315.743036:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683316.770224:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683317.343752:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683317.343777:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1ceb87b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850091008:0@lo:41: 00000100:00100000:2.0:1789683317.343863:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683317.343943:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850091008 00000100:00100000:2.0:1789683317.343963:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850091008 00000100:00100000:2.0:1789683317.344014:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789683317.344022:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000427927fe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850091008:12345-0@lo:41: 00000004:00000024:2.0:1789683317.344060:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789683317.344105:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000427927fe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850091008:12345-0@lo:41: Request processed in 84us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683317.344111:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789683317.344156:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1ceb87b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850091008:0@lo:41: 00000100:00100000:3.0:1789683317.347192:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ab99285 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850091520:0@lo:400: 00000100:00100000:3.0:1789683317.347256:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683317.347303:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683317.347308:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b77242c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850091136:0@lo:400: 00000100:00100000:3.0:1789683317.347336:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683317.347362:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000214e047a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850091264:0@lo:400: 00000100:00100000:3.0:1789683317.347384:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683317.347402:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683317.347419:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008d61d44c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850091392:0@lo:400: 00000100:00100000:3.0:1789683317.347442:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683317.347487:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850091520 00000100:00100000:3.0:1789683317.347496:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850091520 00000100:00100000:3.0:1789683317.347536:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850091264 00000100:00100000:3.0:1789683317.347540:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850091264 00000100:00100000:3.0:1789683317.347555:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683317.347562:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000041089294 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850091520:12345-0@lo:400: 00000100:00100000:3.0:1789683317.347611:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000041089294 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850091520:12345-0@lo:400: Request processed in 49us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683317.347618:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683317.347634:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789683317.347639:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006bcc7536 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850091264:12345-0@lo:400: 00000100:00100000:3.0:1789683317.347683:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006bcc7536 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850091264:12345-0@lo:400: Request processed in 44us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683317.347689:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789683317.347710:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850091392 00000100:00100000:3.0:1789683317.347713:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850091392 00000100:00100000:3.0:1789683317.347738:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789683317.347743:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000022e33246 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850091392:12345-0@lo:400: 00000100:00100000:3.0:1789683317.347773:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000022e33246 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850091392:12345-0@lo:400: Request processed in 30us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683317.347779:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1789683317.347845:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009ab99285 x1876618850091520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683317.347860:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ab99285 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850091520:0@lo:400: 00000100:00100000:3.0:1789683317.347900:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008d61d44c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850091392:0@lo:400: 00010000:00080000:3.0:1789683317.347907:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000214e047a x1876618850091264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683317.347915:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000214e047a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850091264:0@lo:400: 00000100:00100000:0.0:1789683317.349002:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850091136 00000100:00100000:0.0:1789683317.349010:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850091136 00000100:00100000:0.0:1789683317.349051:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789683317.349059:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c8f2fb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:3647:x1876618850091136:12345-0@lo:400: 00000100:00100000:0.0:1789683317.349116:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c8f2fb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:3647:x1876618850091136:12345-0@lo:400: Request processed in 58us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683317.349122:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789683317.351248:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b77242c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850091136:0@lo:400: 00010000:00010000:0.0:1789683317.800020:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683318.372226:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1ceb87b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850091648:0@lo:41: 00000100:00100000:3.0:1789683318.372292:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683318.374462:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850091648 00000100:00100000:2.0:1789683318.374477:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850091648 00000100:00100000:2.0:1789683318.374534:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789683318.374543:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b77242c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850091648:12345-0@lo:41: 00000004:00000024:2.0:1789683318.374589:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1789683318.380141:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b77242c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850091648:12345-0@lo:41: Request processed in 5589us (7838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683318.380159:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789683318.383840:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1ceb87b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850091648:0@lo:41: 00010000:00010000:1.0:1789683318.814992:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683319.840487:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683320.863945:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683321.887046:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789683321.953771:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789683321.953778:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0f88c59000 from 1 10000000:01000000:0.0:1789683321.953804:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789683321.953847:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88935e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683321.953859:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88935e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683321.953871:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88935e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683321.953893:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000934338c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850091776:0@lo:101: 00000100:00100000:0.0:1789683321.953959:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683321.954024:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003eb7296 going to sleep for 11 seconds 00000100:00100000:3.0:1789683321.955975:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850091776 00000100:00100000:3.0:1789683321.955998:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850091776 00000100:00100000:3.0:1789683321.956066:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789683321.956087:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002600b69c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850091776:12345-0@lo:101: 00010000:00010000:3.0:1789683321.956105:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683321.956122:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bbab4e7b/0xcf8485587b889365 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88935e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683321.956147:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bbab4e7b/0xcf8485587b889365 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88935e expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683321.956159:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bbab4e7b/0xcf8485587b889365 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88935e expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683321.956167:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bbab4e7b, rc 0) 00000100:00100000:3.0:1789683321.956232:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002600b69c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850091776:12345-0@lo:101: Request processed in 147us (2273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683321.956238:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789683321.956294:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000934338c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850091776:0@lo:101: 00010000:00010000:3.0:1789683321.956309:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88935e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889365 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683321.956319:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000c79f4d3b/0xcf8485587b88935e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889365 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683321.956422:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000214e047a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850091904:0@lo:501: 00000100:00100000:3.0:1789683321.956467:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683321.956485:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1c36038 going to sleep for 11 seconds 00000100:00100000:3.0:1789683321.956502:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850091904 00000100:00100000:3.0:1789683321.956506:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850091904 00000100:00100000:3.0:1789683321.956530:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789683321.956536:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cd00d977 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850091904:12345-0@lo:501: 00000100:00100000:3.0:1789683321.957163:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cd00d977 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850091904:12345-0@lo:501: Request processed in 626us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683321.957172:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789683321.957207:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000214e047a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850091904:0@lo:501: 00000100:00100000:3.0:1789683321.957256:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000214e047a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850092032:0@lo:503: 00000100:00100000:3.0:1789683321.957294:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683321.957308:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1c36038 going to sleep for 11 seconds 00000100:00100000:3.0:1789683321.957336:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850092032 00000100:00100000:3.0:1789683321.957341:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850092032 00000100:00100000:3.0:1789683321.957366:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789683321.957372:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008f2d491c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850092032:12345-0@lo:503: 00000100:00100000:3.0:1789683321.957725:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008f2d491c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850092032:12345-0@lo:503: Request processed in 352us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683321.957872:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789683321.957927:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000214e047a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850092032:0@lo:503: 00000100:00100000:3.0:1789683321.959852:0:8364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000214e047a pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8364:1876618850092160:0@lo:502: 00000100:00100000:3.0:1789683321.959935:0:8364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683321.960748:0:8364:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c89d617 going to sleep for 11 seconds 00000100:00100000:3.0:1789683321.961313:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850092160 00000100:00100000:3.0:1789683321.961334:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850092160 00000100:00100000:2.0:1789683321.961591:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789683321.961599:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b22f2c30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:8364:x1876618850092160:12345-0@lo:502: 00000100:00100000:2.0:1789683321.961968:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b22f2c30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:8364:x1876618850092160:12345-0@lo:502: Request processed in 368us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683321.961976:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789683321.962587:0:8364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000214e047a pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8364:1876618850092160:0@lo:502: 00000020:01000000:2.0:1789683321.964144:0:8364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683321.964159:0:8364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683321.964162:0:8364:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789683321.964170:0:8364:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0f88c59000 00000020:00000080:2.0:1789683321.964183:0:8364:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789683321.964247:0:8364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8364:1876618850092288:0@lo:502: 00000100:00100000:2.0:1789683321.964336:0:8364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683321.964364:0:8364:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683321.967804:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850092288 00000100:00100000:3.0:1789683321.967825:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850092288 00000100:00100000:3.0:1789683321.967892:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789683321.967904:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:8364:x1876618850092288:12345-0@lo:502: 00000100:00100000:3.0:1789683321.968129:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:8364:x1876618850092288:12345-0@lo:502: Request processed in 227us (3805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683321.968146:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789683321.970965:0:8364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8364:1876618850092288:0@lo:502: 00000020:01000000:2.0:1789683321.981678:0:8364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683321.981692:0:8364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683321.981694:0:8364:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789683321.981699:0:8364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789683321.981906:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789683321.981944:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789683321.981956:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80030000/0xcf8485587b88935e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889365 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683321.981969:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f80030000/0xcf8485587b88935e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889365 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683321.981979:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789683321.981982:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0f8bdba800 from 1 10000000:01000000:3.0:1789683321.981984:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789683321.982020:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0400/0xcf8485587b88936c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683321.982037:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0400/0xcf8485587b88936c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683321.982048:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0400/0xcf8485587b88936c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683321.982073:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850092416:0@lo:101: 00000100:00100000:3.0:1789683321.982148:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683321.982186:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f836103c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683321.982206:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850092416 00000100:00100000:3.0:1789683321.982213:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850092416 00000100:00100000:3.0:1789683321.982253:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789683321.982262:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850092416:12345-0@lo:101: 00010000:00010000:3.0:1789683321.982274:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683321.982292:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f829e1e00/0xcf8485587b889373 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88936c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683321.982342:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f829e1e00/0xcf8485587b889373 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88936c expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683321.982353:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f829e1e00/0xcf8485587b889373 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88936c expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683321.982363:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e1e00, rc 0) 00000100:00100000:3.0:1789683321.982399:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850092416:12345-0@lo:101: Request processed in 138us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683321.982406:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789683321.982446:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850092416:0@lo:101: 00010000:00010000:3.0:1789683321.982461:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0400/0xcf8485587b88936c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889373 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683321.982470:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0400/0xcf8485587b88936c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889373 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683321.982522:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850092544:0@lo:501: 00000100:00100000:3.0:1789683321.982548:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683321.982564:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f836103c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683321.982576:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850092544 00000100:00100000:3.0:1789683321.982580:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850092544 00000100:00100000:3.0:1789683321.982601:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789683321.982608:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850092544:12345-0@lo:501: 00000100:00100000:3.0:1789683321.982715:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850092544:12345-0@lo:501: Request processed in 106us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683321.982730:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789683321.982764:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850092544:0@lo:501: 00000100:00100000:3.0:1789683321.982822:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850092672:0@lo:503: 00000100:00100000:3.0:1789683321.982859:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683321.982873:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f836103c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683321.982884:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850092672 00000100:00100000:3.0:1789683321.982887:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850092672 00000100:00100000:3.0:1789683321.982908:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789683321.982913:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850092672:12345-0@lo:503: 00000100:00100000:3.0:1789683321.982987:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850092672:12345-0@lo:503: Request processed in 73us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683321.982993:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789683321.983034:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850092672:0@lo:503: 00000100:00100000:3.0:1789683321.983197:0:8365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8365:1876618850092800:0@lo:502: 00000100:00100000:3.0:1789683321.983227:0:8365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683321.983244:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850092800 00000100:00100000:3.0:1789683321.983248:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850092800 00000100:00100000:3.0:1789683321.983266:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789683321.983271:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:8365:x1876618850092800:12345-0@lo:502: 00000100:00100000:3.0:1789683321.983361:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:8365:x1876618850092800:12345-0@lo:502: Request processed in 88us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683321.983367:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789683321.983401:0:8365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f836103c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683321.983413:0:8365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8365:1876618850092800:0@lo:502: 00000020:01000000:3.0:1789683321.983432:0:8365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683321.983443:0:8365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683321.983445:0:8365:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789683321.983452:0:8365:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0f8bdba800 00000020:00000080:3.0:1789683321.983454:0:8365:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789683321.983477:0:8365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8365:1876618850092928:0@lo:502: 00000100:00100000:3.0:1789683321.983508:0:8365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683321.983526:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850092928 00000100:00100000:3.0:1789683321.983531:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850092928 00000100:00100000:3.0:1789683321.983552:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789683321.983557:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:8365:x1876618850092928:12345-0@lo:502: 00000100:00100000:3.0:1789683321.983609:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:8365:x1876618850092928:12345-0@lo:502: Request processed in 51us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683321.983616:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789683321.983645:0:8365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f836103c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683321.983656:0:8365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8365:1876618850092928:0@lo:502: 00000020:01000000:3.0:1789683321.983672:0:8365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683321.983676:0:8365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683321.983677:0:8365:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789683321.983680:0:8365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789683321.983719:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789683321.983734:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789683321.983741:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0400/0xcf8485587b88936c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889373 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683321.983751:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0400/0xcf8485587b88936c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889373 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683322.463410:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850093056:0@lo:400: 00000100:00100000:3.0:1789683322.463484:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683322.463558:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683322.463567:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850093184:0@lo:400: 00000100:00100000:3.0:1789683322.463594:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683322.463644:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850093440:0@lo:400: 00000100:00100000:3.0:1789683322.463682:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683322.463711:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683322.463717:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850093312:0@lo:400: 00000100:00100000:3.0:1789683322.463741:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683322.463770:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850093056 00000100:00100000:3.0:1789683322.463805:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850093056 00000100:00100000:3.0:1789683322.463847:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850093312 00000100:00100000:3.0:1789683322.463850:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850093312 00000100:00100000:3.0:1789683322.463866:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789683322.463874:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850093056:12345-0@lo:400: 00000100:00100000:3.0:1789683322.463929:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850093056:12345-0@lo:400: Request processed in 56us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683322.463936:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789683322.463954:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789683322.463960:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850093312:12345-0@lo:400: 00000100:00100000:3.0:1789683322.463991:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850093312:12345-0@lo:400: Request processed in 31us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683322.463996:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789683322.464016:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850093184 00000100:00100000:3.0:1789683322.464020:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850093184 00000100:00100000:3.0:1789683322.464041:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850093440 00000100:00100000:3.0:1789683322.464044:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850093440 00000100:00100000:3.0:1789683322.464056:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789683322.464062:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850093184:12345-0@lo:400: 00000100:00100000:3.0:1789683322.464106:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850093184:12345-0@lo:400: Request processed in 43us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683322.464112:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789683322.464124:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789683322.464131:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850093440:12345-0@lo:400: 00000100:00100000:3.0:1789683322.464159:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850093440:12345-0@lo:400: Request processed in 29us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683322.464165:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1789683322.464206:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0f88cddf80 x1876618850093312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683322.464222:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850093312:0@lo:400: 00000100:00100000:3.0:1789683322.464233:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850093440:0@lo:400: 00000100:00100000:3.0:1789683322.464261:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850093184:0@lo:400: 00010000:00080000:3.0:1789683322.464269:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0f88cdfb80 x1876618850093056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683322.464278:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850093056:0@lo:400: 00000100:00100000:0.0:1789683322.466255:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683322.466279:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850093568:0@lo:41: 00000100:00100000:0.0:1789683322.466355:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683322.466405:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850093568 00000100:00100000:0.0:1789683322.466412:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850093568 00000100:00100000:0.0:1789683322.466455:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789683322.466465:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850093568:12345-0@lo:41: 00000004:00000024:0.0:1789683322.466498:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789683322.466550:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850093568:12345-0@lo:41: Request processed in 87us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683322.466557:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789683322.466601:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850093568:0@lo:41: 00010000:00010000:1.0:1789683322.911018:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789683323.135241:0:8431:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789683323.135244:0:8431:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789683323.135246:0:8431:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789683323.135400:0:8431:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0fb62ea800 00000020:01000004:2.0:1789683323.135418:0:8431:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789683323.135431:0:8431:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789683323.135444:0:8431:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9f0fb504b380) 00000020:00000080:2.0:1789683323.135458:0:8431:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789683323.173259:0:8431:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789683323.174564:0:8431:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1789683323.213768:0:8431:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789683323.213998:0:8431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789683323.214010:0:8431:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789683323.214021:0:8431:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf8485587b889381 00000020:01000004:3.0:1789683323.214027:0:8431:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789683323.214047:0:8431:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789683323.214050:0:8431:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789683323.214055:0:8431:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789683323.214059:0:8431:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789683323.214077:0:8431:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9f0fc12419c0) 00000020:00000080:3.0:1789683323.214087:0:8431:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1789683323.215406:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789683323.215599:0:8431:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789683323.215605:0:8431:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789683323.229329:0:8431:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789683323.229344:0:8431:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789683323.241348:0:8431:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789683323.241366:0:8431:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789683323.243739:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789683323.253949:0:8431:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789683323.253963:0:8431:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789683323.261661:0:8431:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789683323.261682:0:8431:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789683323.294502:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683323.303059:0:8431:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789683323.303071:0:8431:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789683323.304586:0:8431:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789683323.304607:0:8431:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789683323.305991:0:8431:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789683323.306003:0:8431:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789683323.308550:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683323.308737:0:8431:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789683323.308744:0:8431:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789683323.309472:0:8431:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789683323.309479:0:8431:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789683323.366184:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683323.366413:0:8431:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789683323.366420:0:8431:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789683323.368726:0:8431:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789683323.368741:0:8431:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789683323.369294:0:8431:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789683323.369337:0:8431:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789683323.369344:0:8431:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789683323.384537:0:8431:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789683323.384575:0:8431:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.150@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789683323.384579:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789683323.384581:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789683323.384583:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683323.384584:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683323.384585:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683323.384587:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683323.384588:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683323.384590:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789683323.384591:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789683323.384593:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683323.384594:0:8431:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789683323.384597:0:8431:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789683323.384600:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789683323.384602:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789683323.384602:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683323.384604:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683323.384604:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683323.384605:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683323.384606:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683323.384607:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789683323.384614:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789683323.384615:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683323.384615:0:8431:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789683323.384642:0:8431:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789683323.384663:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850093696:0@lo:253: 00000100:00100000:0.0:1789683323.384737:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683323.384983:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e810bf840 going to sleep for 11 seconds 00000100:00100000:3.0:1789683323.385039:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850093696 00000100:00100000:3.0:1789683323.385048:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850093696 00000100:00100000:3.0:1789683323.385126:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789683323.385135:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:8431:x1876618850093696:12345-0@lo:253: 20000000:01000000:3.0:1789683323.385162:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789683323.385166:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789683323.385172:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789683323.385176:0:6514:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789683323.385380:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683323.385497:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789683323.385509:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789683323.385524:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789683323.385528:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789683323.385550:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789683323.385563:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789683323.385647:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789683323.385660:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.150@tcp 20000000:01000000:3.0:1789683323.385668:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:3.0:1789683323.385685:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789683323.385692:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789683323.385706:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789683323.385711:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:3.0:1789683323.385724:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789683323.385731:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789683323.385743:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789683323.385758:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789683323.386053:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1789683323.386064:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.150@tcp 20000000:01000000:3.0:1789683323.386065:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:3.0:1789683323.386077:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1789683323.386081:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789683323.386091:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1789683323.386095:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:3.0:1789683323.386105:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1789683323.386110:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789683323.386120:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1789683323.386132:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1789683323.386563:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1789683323.386574:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.150@tcp 20000000:01000000:3.0:1789683323.386575:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:3.0:1789683323.386587:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1789683323.386592:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789683323.386619:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1789683323.386624:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:3.0:1789683323.386636:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1789683323.386642:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789683323.386653:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1789683323.386678:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1789683323.386691:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789683323.386694:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789683323.386697:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789683323.386737:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789683323.386739:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789683323.387381:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789683323.387583:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789683323.387606:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1789683323.387621:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1789683323.387631:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789683323.387633:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789683323.388057:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1789683323.388080:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1789683323.388091:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1789683323.388233:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1789683323.388248:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1789683323.388261:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1789683323.388344:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789683323.388346:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789683323.388579:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1789683323.388597:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1789683323.388610:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789683323.388752:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1789683323.388771:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1789683323.388924:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1789683323.388936:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789683323.388938:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789683323.389236:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1789683323.389255:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1789683323.389268:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789683323.389467:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789683323.389484:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789683323.389497:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:1.0:1789683323.389509:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789683323.389528:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0f81677200/0xcf8485587b88938f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.389547:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b88925b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889254 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.389556:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f80030c00/0xcf8485587b8892d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8892cb expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.389563:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f829e1a00/0xcf8485587b88930a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889303 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.389570:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f81676e00/0xcf8485587b889326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88931f expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.389576:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f829e1800/0xcf8485587b889350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889349 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.389583:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0f81677200/0xcf8485587b88938f lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.389630:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f829e1800/0xcf8485587b889350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b889349 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.389645:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f829e1800/0xcf8485587b889350 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b889349 expref: 18 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683323.389661:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876618850093824:0@lo:104: 00000100:00100000:1.0:1789683323.393610:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683323.393734:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f81676e00/0xcf8485587b889326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88931f expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.393753:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f81676e00/0xcf8485587b889326 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88931f expref: 18 pid: 6515 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683323.393769:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876618850093952:0@lo:104: 00000100:00100000:1.0:1789683323.393819:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683323.394038:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f829e1a00/0xcf8485587b88930a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b889303 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.394048:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f829e1a00/0xcf8485587b88930a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b889303 expref: 18 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683323.394057:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876618850094080:0@lo:104: 00000100:00100000:1.0:1789683323.394077:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683323.394112:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850093824 00000100:00100000:3.0:1789683323.394121:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850093824 00000100:00100000:3.0:1789683323.394161:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850093952 00000100:00100000:3.0:1789683323.394163:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850093952 00000100:00100000:3.0:1789683323.394174:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789683323.394182:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7245f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:6514:x1876618850093824:12345-0@lo:104: 00010000:00010000:3.0:1789683323.394195:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889350 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.394253:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789683323.394259:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7245f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:6514:x1876618850093824:12345-0@lo:104: Request processed in 78us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683323.394266:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789683323.394290:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789683323.394296:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7245880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:6514:x1876618850093952:12345-0@lo:104: 00010000:00010000:3.0:1789683323.394324:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0a00/0xcf8485587b88931f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889326 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.394356:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789683323.394360:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7245880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:6514:x1876618850093952:12345-0@lo:104: Request processed in 66us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683323.394366:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1789683323.394382:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683323.394388:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889350 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.394395:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9200 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683323.394399:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b889350 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.394409:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b889350 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683323.394416:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b889350 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683323.394422:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683323.394448:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889349 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889350 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.394454:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683323.394469:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889349 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889350 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.394477:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889349 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889350 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.394494:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683323.394498:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0a00/0xcf8485587b88931f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889326 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.394504:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f829e0a00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683323.394507:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0a00/0xcf8485587b88931f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b889326 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.394513:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0a00/0xcf8485587b88931f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b889326 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683323.394520:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0a00/0xcf8485587b88931f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b889326 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683323.394525:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683323.394535:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0a00/0xcf8485587b88931f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889326 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.394540:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683323.394554:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0a00/0xcf8485587b88931f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889326 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.394561:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0a00/0xcf8485587b88931f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889326 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.394571:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683323.394573:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683323.394574:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683323.394596:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850094208:0@lo:103: 00000100:00100000:3.0:1789683323.394630:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683323.394665:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850094336:0@lo:103: 00000100:00100000:3.0:1789683323.394686:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683323.394715:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850094208 00000100:00100000:3.0:1789683323.394720:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850094208 00010000:00010000:3.0:1789683323.394737:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f829e1800/0xcf8485587b889350 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889349 expref: 19 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683323.394755:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850094336 00000100:00100000:3.0:1789683323.394758:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850094336 00010000:00010000:3.0:1789683323.394768:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f81676e00/0xcf8485587b889326 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88931f expref: 20 pid: 6515 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683323.394779:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789683323.394811:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:3650:x1876618850094208:12345-0@lo:103: 00010000:00010000:3.0:1789683323.394821:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683323.394825:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f829e1800/0xcf8485587b889350 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889349 expref: 20 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.394836:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f829e1800/0xcf8485587b889350 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b889349 expref: 20 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.394852:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683323.394879:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:3650:x1876618850094208:12345-0@lo:103: Request processed in 94us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683323.394885:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789683323.394897:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789683323.394903:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+19:3647:x1876618850094336:12345-0@lo:103: 00010000:00010000:3.0:1789683323.394911:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683323.394921:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f81676e00/0xcf8485587b889326 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88931f expref: 19 pid: 6515 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.394930:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f81676e00/0xcf8485587b889326 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88931f expref: 19 pid: 6515 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.394939:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683323.394963:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+19:3647:x1876618850094336:12345-0@lo:103: Request processed in 61us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683323.394969:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789683323.395001:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850094336:0@lo:103: 00000100:00100000:3.0:1789683323.395019:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850094208:0@lo:103: 00010000:00010000:2.0:1789683323.395083:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683323.395331:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f80030c00/0xcf8485587b8892d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b8892cb expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.395342:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f80030c00/0xcf8485587b8892d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b8892cb expref: 18 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683323.395363:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876618850094464:0@lo:104: 00000100:00100000:1.0:1789683323.395401:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683323.395426:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b88925b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b889254 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.395435:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b88925b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b889254 expref: 18 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683323.395444:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d41f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876618850094592:0@lo:104: 00000100:00100000:1.0:1789683323.395461:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683323.395469:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c210cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1789683323.395481:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f829e1800/0xcf8485587b889350 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b889349 expref: 18 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683323.395491:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876618850093824:0@lo:104: 00010000:00010000:1.0:1789683323.395499:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81676e00/0xcf8485587b889326 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88931f expref: 17 pid: 6515 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683323.395507:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876618850093952:0@lo:104: 00000100:00100000:3.0:1789683323.395562:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850094080 00000100:00100000:3.0:1789683323.395567:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850094080 00000100:00100000:3.0:1789683323.395586:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850094464 00000100:00100000:3.0:1789683323.395588:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850094464 00000100:00100000:3.0:1789683323.395596:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850094592 00000100:00100000:3.0:1789683323.395598:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850094592 00000100:00100000:3.0:1789683323.395607:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789683323.395612:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:6514:x1876618850094080:12345-0@lo:104: 00010000:00010000:3.0:1789683323.395622:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b889303 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88930a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683323.395735:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876618850094080:0@lo:104: 00010000:00010000:3.0:1789683323.395760:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789683323.395766:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:6514:x1876618850094080:12345-0@lo:104: Request processed in 153us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683323.395772:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789683323.395815:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683323.395822:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:6514:x1876618850094464:12345-0@lo:104: 00010000:00010000:3.0:1789683323.395836:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8892cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8892d2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683323.395915:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876618850094464:0@lo:104: 00010000:00010000:2.0:1789683323.396049:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683323.396056:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b889303 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88930a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.396063:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677600 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683323.396067:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b889303 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88930a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.396075:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b889303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88930a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683323.396083:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b889303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88930a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683323.396088:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789683323.396120:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b889303 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88930a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.396127:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683323.396148:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b889303 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88930a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.396155:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b889303 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88930a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.396164:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683323.396167:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8892cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8892d2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.396179:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8200 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683323.396182:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8892cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8892d2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.396189:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8892cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8892d2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683323.396195:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8892cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8892d2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683323.396200:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789683323.396212:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8892cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8892d2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.396217:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683323.396227:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8892cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8892d2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.396234:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8892cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8892d2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.396242:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683323.396244:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683323.396246:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683323.396256:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850094848:0@lo:103: 00000100:00100000:1.0:1789683323.396358:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850094720:0@lo:103: 00000100:00100000:1.0:1789683323.396382:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683323.396442:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683323.396504:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850094720 00000100:00100000:1.0:1789683323.396508:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850094720 00010000:00010000:1.0:1789683323.396528:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f829e1a00/0xcf8485587b88930a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889303 expref: 17 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683323.396559:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850094848 00000100:00100000:1.0:1789683323.396562:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850094848 00010000:00010000:1.0:1789683323.396572:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f80030c00/0xcf8485587b8892d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8892cb expref: 18 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683323.396583:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789683323.396589:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:3648:x1876618850094720:12345-0@lo:103: 00010000:00010000:1.0:1789683323.396598:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683323.396603:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f829e1a00/0xcf8485587b88930a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889303 expref: 18 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.396612:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f829e1a00/0xcf8485587b88930a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b889303 expref: 18 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.396623:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f829e1a00/0xcf8485587b88930a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b889303 expref: 18 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.396633:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683323.396663:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:3648:x1876618850094720:12345-0@lo:103: Request processed in 74us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683323.396669:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789683323.396684:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789683323.396690:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:3649:x1876618850094848:12345-0@lo:103: 00010000:00010000:1.0:1789683323.396697:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683323.396701:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f80030c00/0xcf8485587b8892d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8892cb expref: 16 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.396710:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f80030c00/0xcf8485587b8892d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b8892cb expref: 16 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.396727:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f80030c00/0xcf8485587b8892d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b8892cb expref: 16 pid: 6514 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.396735:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683323.396760:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:3649:x1876618850094848:12345-0@lo:103: Request processed in 71us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683323.396766:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789683323.396819:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850094720:0@lo:103: 00000100:00100000:2.0:1789683323.396952:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850094848:0@lo:103: 00010000:00010000:3.0:1789683323.397096:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789683323.397103:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:6514:x1876618850094464:12345-0@lo:104: Request processed in 1282us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683323.397110:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683323.397125:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789683323.397132:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:6514:x1876618850094592:12345-0@lo:104: 00010000:00010000:3.0:1789683323.397141:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0e00/0xcf8485587b889254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88925b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683323.397215:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d41f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876618850094592:0@lo:104: 00010000:00010000:1.0:1789683323.397240:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0f81677200/0xcf8485587b88938f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397343:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683323.397354:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0e00/0xcf8485587b889254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88925b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397361:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f829e0e00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683323.397364:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0e00/0xcf8485587b889254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88925b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397372:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0e00/0xcf8485587b889254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88925b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683323.397379:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0e00/0xcf8485587b889254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88925b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683323.397384:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789683323.397438:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0e00/0xcf8485587b889254 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88925b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397445:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683323.397467:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0e00/0xcf8485587b889254 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88925b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397473:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0e00/0xcf8485587b889254 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88925b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397488:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683323.397490:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683323.397492:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683323.397497:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683323.397506:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850094976:0@lo:103: 00000100:00100000:2.0:1789683323.397534:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683323.397559:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850094976 00000100:00100000:2.0:1789683323.397569:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850094976 00010000:00010000:2.0:1789683323.397589:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b88925b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889254 expref: 15 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683323.397609:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789683323.397616:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb29f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:3649:x1876618850094976:12345-0@lo:103: 00010000:00010000:2.0:1789683323.397625:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683323.397629:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b88925b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889254 expref: 15 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397638:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b88925b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b889254 expref: 15 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397648:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b88925b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b889254 expref: 15 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397659:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0f81677200/0xcf8485587b88938f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397667:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81677200/0xcf8485587b88938f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397682:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0f81677200/0xcf8485587b88938f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397690:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0f81677200/0xcf8485587b88938f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397696:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0f81677200/0xcf8485587b88938f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397703:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0f81677200/0xcf8485587b88938f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397714:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683323.397718:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0f81677200/0xcf8485587b88938f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397725:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0f81677200/0xcf8485587b88938f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397738:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0f81677200/0xcf8485587b88938f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397747:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683323.397774:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb29f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:3649:x1876618850094976:12345-0@lo:103: Request processed in 158us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683323.397779:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789683323.397859:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850094976:0@lo:103: 00010000:00010000:2.0:1789683323.397875:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0f81677200/0xcf8485587b88938f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397883:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0f81677200/0xcf8485587b88938f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.397888:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81677200/0xcf8485587b88938f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789683323.397902:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1789683323.398609:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789683323.398618:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:6514:x1876618850094592:12345-0@lo:104: Request processed in 1486us (3154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683323.398626:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789683323.398681:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683323.401821:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+13:8431:x1876618850093696:12345-0@lo:253: Request processed in 16646us (17043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683323.401839:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789683323.402013:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850093696:0@lo:253: 10000000:01000000:0.0:1789683323.402028:0:8431:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789683323.402031:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789683323.402032:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789683323.402034:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683323.402035:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1789683323.402036:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683323.402038:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683323.402039:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683323.402041:0:8431:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789683323.402042:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683323.402043:0:8431:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789683323.402065:0:8431:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0fb62ea800 from lustre-OST0000 10000000:01000000:0.0:1789683323.402097:0:8431:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789683323.402099:0:8431:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789683323.402106:0:8431:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f0fa508b380 local copy 10000000:01000000:0.0:1789683323.402110:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789683323.402146:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80031200/0xcf8485587b889396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683323.402156:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.150@tcp lock: ffff9f0f80031200/0xcf8485587b889396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683323.402165:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f80031200/0xcf8485587b889396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683323.402182:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850095104:0@lo:101: 00000100:00100000:0.0:1789683323.402231:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683323.402377:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e810bf000 going to sleep for 11 seconds 00000100:00100000:1.0:1789683323.402537:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850095104 00000100:00100000:1.0:1789683323.402544:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850095104 00000100:00100000:1.0:1789683323.402577:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789683323.402585:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+13:8431:x1876618850095104:12345-0@lo:101: 00010000:00010000:1.0:1789683323.402598:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683323.402611:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88939d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889396 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.402634:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88939d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889396 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.402646:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88939d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889396 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.402662:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81676e00, rc 0) 00000100:00100000:1.0:1789683323.402699:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:8431:x1876618850095104:12345-0@lo:101: Request processed in 114us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683323.402705:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789683323.402909:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850095104:0@lo:101: 00010000:00010000:1.0:1789683323.402923:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f80031200/0xcf8485587b889396 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcf8485587b88939d expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683323.402933:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f80031200/0xcf8485587b889396 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf8485587b88939d expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683323.403024:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850095232:0@lo:501: 00000100:00100000:1.0:1789683323.403050:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683323.403175:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c210e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683323.403213:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850095232 00000100:00100000:2.0:1789683323.403218:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850095232 00000100:00100000:2.0:1789683323.403248:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789683323.403261:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:8431:x1876618850095232:12345-0@lo:501: 00000100:00100000:2.0:1789683323.403339:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:8431:x1876618850095232:12345-0@lo:501: Request processed in 78us (288us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789683323.403346:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789683323.403375:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850095232:0@lo:501: 10000000:01000000:2.0:1789683323.403387:0:8431:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789683323.403404:0:8431:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789683323.403409:0:8431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80031200/0xcf8485587b889396 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf8485587b88939d expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.403418:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80031200/0xcf8485587b889396 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf8485587b88939d expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.403425:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0f80031200/0xcf8485587b889396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf8485587b88939d expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.403441:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789683323.403462:0:8431:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0fb62ea800 00010000:00010000:2.0:1789683323.403470:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683323.403476:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f80031200/0xcf8485587b889396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcf8485587b88939d expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.403483:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f80031200 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683323.403487:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80031200/0xcf8485587b889396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcf8485587b88939d expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.403497:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f80031200/0xcf8485587b889396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xcf8485587b88939d expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683323.403514:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80031200/0xcf8485587b889396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xcf8485587b88939d expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683323.403519:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789683323.403538:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f80031200/0xcf8485587b889396 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf8485587b88939d expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.403544:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683323.403561:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f80031200/0xcf8485587b889396 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf8485587b88939d expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.403568:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f80031200/0xcf8485587b889396 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf8485587b88939d expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.403583:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683323.403585:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683323.403586:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683323.403593:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683323.403605:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850095360:0@lo:103: 00000100:00100000:2.0:1789683323.403633:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683323.403663:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850095360 00000100:00100000:2.0:1789683323.403667:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850095360 00000100:00100000:2.0:1789683323.403697:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789683323.403704:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:3648:x1876618850095360:12345-0@lo:103: 00010000:00010000:2.0:1789683323.403714:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683323.403726:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88939d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b889396 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.403739:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683323.403808:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+13:3648:x1876618850095360:12345-0@lo:103: Request processed in 104us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683323.403814:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789683323.403843:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850095360:0@lo:103: 10000000:01000000:2.0:1789683323.403859:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789683323.403865:0:8431:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789683323.403868:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789683323.403873:0:8431:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789683323.403876:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789683323.403893:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8893a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.403901:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8893a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.403909:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8893a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683323.403921:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850095488:0@lo:101: 00000100:00100000:2.0:1789683323.403945:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683323.403964:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850095488 00000100:00100000:2.0:1789683323.403967:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850095488 00000100:00100000:2.0:1789683323.403985:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789683323.403991:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+13:8431:x1876618850095488:12345-0@lo:101: 00010000:00010000:2.0:1789683323.403998:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683323.404007:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b8893ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8893a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.404020:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b8893ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8893a4 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.404034:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b8893ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8893a4 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.404041:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f8600, rc 0) 00000100:00100000:2.0:1789683323.404066:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:8431:x1876618850095488:12345-0@lo:101: Request processed in 75us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683323.404072:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789683323.404095:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f98ff00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683323.404106:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850095488:0@lo:101: 00010000:00010000:2.0:1789683323.404116:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8893a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8893ab expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.404123:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8893a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8893ab expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683323.404177:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850095616:0@lo:501: 00000100:00100000:2.0:1789683323.404200:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683323.404216:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850095616 00000100:00100000:2.0:1789683323.404219:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850095616 00000100:00100000:2.0:1789683323.404236:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789683323.404241:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:8431:x1876618850095616:12345-0@lo:501: 00000100:00100000:2.0:1789683323.404334:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:8431:x1876618850095616:12345-0@lo:501: Request processed in 92us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683323.404340:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789683323.404360:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f98ff00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683323.404369:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850095616:0@lo:501: 00000100:00100000:2.0:1789683323.404407:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850095744:0@lo:503: 00000100:00100000:2.0:1789683323.404439:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683323.404455:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850095744 00000100:00100000:2.0:1789683323.404458:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850095744 00000100:00100000:2.0:1789683323.404474:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789683323.404479:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:8431:x1876618850095744:12345-0@lo:503: 00000100:00100000:2.0:1789683323.404543:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:8431:x1876618850095744:12345-0@lo:503: Request processed in 63us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683323.404550:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789683323.404582:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f98ff00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683323.404593:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850095744:0@lo:503: 00000040:00080000:2.0:1789683323.404858:0:8431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789683323.404917:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850095872:0@lo:502: 00000100:00100000:2.0:1789683323.404949:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683323.404969:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850095872 00000100:00100000:2.0:1789683323.404973:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850095872 00000100:00100000:2.0:1789683323.404990:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789683323.404995:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:8431:x1876618850095872:12345-0@lo:502: 00000100:00100000:2.0:1789683323.405055:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:8431:x1876618850095872:12345-0@lo:502: Request processed in 59us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683323.405061:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789683323.405092:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683323.405104:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850095872:0@lo:502: 00000040:00080000:2.0:1789683323.405271:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789683323.405293:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789683323.405320:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789683323.405340:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789683323.405362:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789683323.405374:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789683323.405390:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850096000:0@lo:502: 00000100:00100000:2.0:1789683323.405418:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683323.405436:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850096000 00000100:00100000:2.0:1789683323.405440:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850096000 00000100:00100000:2.0:1789683323.405457:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789683323.405462:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:8431:x1876618850096000:12345-0@lo:502: 00000100:00100000:2.0:1789683323.405511:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:8431:x1876618850096000:12345-0@lo:502: Request processed in 48us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683323.405518:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789683323.405547:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683323.405559:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850096000:0@lo:502: 00000040:00080000:2.0:1789683323.405591:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789683323.405598:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789683323.406469:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789683323.406480:0:8454:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789683323.406486:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683323.406488:0:8454:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789683323.406494:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789683323.406511:0:8454:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9f0fc1240000) 00000020:00000080:3.0:1789683323.406534:0:8454:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789683323.406540:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789683323.406617:0:8454:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0fb62ea800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789683323.406626:0:8454:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789683323.406634:0:8454:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf8485587b8893b9 00010000:00010000:3.0:1789683323.411974:0:8454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1789683323.412387:0:8454:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789683323.415083:0:8454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789683323.415649:0:8454:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789683323.418716:0:8454:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1789683323.421048:0:8454:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1789683323.426419:0:8454:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1789683323.427691:0:8454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789683323.427705:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683323.427713:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683323.427715:0:8454:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789683323.427718:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683323.427722:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683323.427724:0:8454:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789683323.427727:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789683323.427729:0:8454:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789683323.427754:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683323.427757:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683323.427758:0:8454:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789683323.427979:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789683323.429954:0:8431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1789683323.429996:0:8431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789683323.430062:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8893a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8893ab expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.430075:0:8431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8893a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8893ab expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683323.430083:0:8431:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0fb62ea800 from 1 10000000:01000000:2.0:1789683323.430086:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683323.430124:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b8893c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.430144:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b8893c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.430156:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b8893c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683323.430176:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850096128:0@lo:101: 00000100:00100000:2.0:1789683323.430233:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683323.430669:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850096128 00000100:00100000:3.0:1789683323.430678:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850096128 00000100:00100000:3.0:1789683323.430733:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789683323.430743:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:8431:x1876618850096128:12345-0@lo:101: 00010000:00010000:3.0:1789683323.430769:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683323.430808:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f829e0a00/0xcf8485587b8893c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8893c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.430832:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f829e0a00/0xcf8485587b8893c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8893c0 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.430843:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f829e0a00/0xcf8485587b8893c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8893c0 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.430863:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e0a00, rc 0) 00000100:00100000:3.0:1789683323.430904:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:8431:x1876618850096128:12345-0@lo:101: Request processed in 162us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683323.430911:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789683323.431047:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683323.431069:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850096128:0@lo:101: 00010000:00010000:2.0:1789683323.431084:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b8893c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8893c7 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.431094:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b8893c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8893c7 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683323.431175:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850096256:0@lo:501: 00000100:00100000:2.0:1789683323.431199:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683323.431222:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683323.431265:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850096256 00000100:00100000:3.0:1789683323.431277:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850096256 00000100:00100000:3.0:1789683323.431318:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789683323.431324:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:8431:x1876618850096256:12345-0@lo:501: 00000100:00100000:3.0:1789683323.431406:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:8431:x1876618850096256:12345-0@lo:501: Request processed in 82us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683323.431412:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789683323.431530:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850096256:0@lo:501: 00000100:00100000:2.0:1789683323.431554:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850096384:0@lo:503: 00000100:00100000:2.0:1789683323.431592:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683323.431611:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683323.431674:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850096384 00000100:00100000:1.0:1789683323.431679:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850096384 00000100:00100000:1.0:1789683323.431710:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789683323.431717:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:8431:x1876618850096384:12345-0@lo:503: 00000100:00100000:1.0:1789683323.431926:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:8431:x1876618850096384:12345-0@lo:503: Request processed in 209us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683323.431932:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789683323.432001:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850096384:0@lo:503: 00000040:00080000:2.0:1789683323.432224:0:8431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789683323.432369:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850096512:0@lo:502: 00000100:00100000:2.0:1789683323.432408:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683323.432435:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850096512 00000100:00100000:2.0:1789683323.432439:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850096512 00000100:00100000:2.0:1789683323.432473:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789683323.432480:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:8431:x1876618850096512:12345-0@lo:502: 00000100:00100000:2.0:1789683323.432549:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:8431:x1876618850096512:12345-0@lo:502: Request processed in 69us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683323.432555:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789683323.432583:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683323.432594:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850096512:0@lo:502: 00000040:00080000:2.0:1789683323.432887:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789683323.432910:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789683323.432928:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850096640:0@lo:502: 00000100:00100000:2.0:1789683323.432957:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683323.432977:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850096640 00000100:00100000:2.0:1789683323.432981:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850096640 00000100:00100000:2.0:1789683323.432996:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789683323.433002:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f93123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:8431:x1876618850096640:12345-0@lo:502: 00000100:00100000:2.0:1789683323.433052:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f93123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:8431:x1876618850096640:12345-0@lo:502: Request processed in 50us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683323.433058:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789683323.433083:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683323.433094:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850096640:0@lo:502: 00000040:00080000:2.0:1789683323.433123:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789683323.433130:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789683323.436605:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683323.436619:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683323.436622:0:8458:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789683323.436630:0:8458:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0fb62ea800 00000020:00000080:3.0:1789683323.436633:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789683323.436651:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683323.436654:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683323.436656:0:8458:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789683323.436659:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789683323.436847:0:8431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789683323.436887:0:8431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683323.436905:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b8893c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8893c7 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.436918:0:8431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b8893c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8893c7 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683323.436965:0:8431:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789683323.436969:0:8431:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0fb62ea800 10000000:01000000:2.0:1789683323.436972:0:8431:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0fb62ea800 10000000:01000000:2.0:1789683323.436975:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789683323.436981:0:8431:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0fb62ea800 from 1 10000000:01000000:2.0:1789683323.436983:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789683323.437022:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8893ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.437030:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8893ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.437042:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8893ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683323.437068:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850096768:0@lo:101: 00000100:00100000:2.0:1789683323.437149:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683323.437196:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b5300 going to sleep for 11 seconds 00000100:00100000:3.0:1789683323.437413:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850096768 00000100:00100000:3.0:1789683323.437421:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850096768 00000100:00100000:3.0:1789683323.437469:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789683323.437478:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:8431:x1876618850096768:12345-0@lo:101: 00010000:00010000:3.0:1789683323.437491:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683323.437504:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8893d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8893ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.437537:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8893d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8893ce expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.437549:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8893d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8893ce expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.437559:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e0800, rc 0) 00000100:00100000:3.0:1789683323.437607:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:8431:x1876618850096768:12345-0@lo:101: Request processed in 129us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683323.437614:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789683323.437934:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850096768:0@lo:101: 00010000:00010000:0.0:1789683323.437950:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8893ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8893d5 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683323.437960:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8893ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8893d5 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683323.438062:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850096896:0@lo:501: 00000100:00100000:0.0:1789683323.438109:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683323.438126:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e810bfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683323.438182:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850096896 00000100:00100000:2.0:1789683323.438187:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850096896 00000100:00100000:2.0:1789683323.438213:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789683323.438220:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:8431:x1876618850096896:12345-0@lo:501: 00000100:00100000:2.0:1789683323.438338:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:8431:x1876618850096896:12345-0@lo:501: Request processed in 118us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683323.438351:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789683323.438476:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850096896:0@lo:501: 00000100:00100000:0.0:1789683323.438501:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850097024:0@lo:503: 00000100:00100000:0.0:1789683323.438534:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683323.438560:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e810bfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683323.438711:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850097024 00000100:00100000:2.0:1789683323.438717:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850097024 00000100:00100000:2.0:1789683323.438739:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789683323.438746:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc2073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:8431:x1876618850097024:12345-0@lo:503: 00000100:00100000:2.0:1789683323.438848:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc2073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:8431:x1876618850097024:12345-0@lo:503: Request processed in 102us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683323.438855:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789683323.438951:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850097024:0@lo:503: 00000040:00080000:0.0:1789683323.439202:0:8431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789683323.439264:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850097152:0@lo:502: 00000100:00100000:0.0:1789683323.439323:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683323.439347:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e810bfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683323.439464:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850097152 00000100:00100000:2.0:1789683323.439469:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850097152 00000100:00100000:2.0:1789683323.439502:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789683323.439509:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc2071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:8431:x1876618850097152:12345-0@lo:502: 00000100:00100000:2.0:1789683323.440382:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc2071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:8431:x1876618850097152:12345-0@lo:502: Request processed in 871us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683323.440390:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789683323.440443:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850097152:0@lo:502: 00000040:00080000:2.0:1789683323.440626:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789683323.440656:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789683323.440669:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789683323.440683:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789683323.440697:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789683323.440711:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789683323.440724:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789683323.440737:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789683323.440750:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789683323.440763:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789683323.440775:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789683323.440809:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789683323.440836:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789683323.440849:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789683323.440861:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789683323.440873:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789683323.440887:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789683323.440901:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789683323.440914:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789683323.440928:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789683323.440953:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789683323.440967:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789683323.440979:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789683323.440992:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789683323.441003:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789683323.441013:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789683323.441025:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789683323.441036:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1789683323.441048:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789683323.441060:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1789683323.441073:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1789683323.441085:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1789683323.441096:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1789683323.441108:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1789683323.441118:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1789683323.441129:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1789683323.441156:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1789683323.441190:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850097280:0@lo:502: 00000100:00100000:2.0:1789683323.441231:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683323.441262:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850097280 00000100:00100000:2.0:1789683323.443606:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850097280 00000100:00100000:2.0:1789683323.443676:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789683323.443685:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:8431:x1876618850097280:12345-0@lo:502: 00000100:00100000:2.0:1789683323.443919:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:8431:x1876618850097280:12345-0@lo:502: Request processed in 235us (2687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683323.443928:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789683323.443983:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683323.444005:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850097280:0@lo:502: 00000040:00080000:2.0:1789683323.444074:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1789683323.444085:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1789683323.445477:0:8459:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789683323.445499:0:8459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9f0e824099c0) 00000020:00000080:0.0:1789683323.445521:0:8459:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789683323.445600:0:8459:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0fb62ea800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789683323.445604:0:8459:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0fb62ea800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789683323.445612:0:8459:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0fb62ea800 3 00010000:00080000:0.0:1789683323.445642:0:8459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0fb5158000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.150@tcp at head 00010000:00010000:0.0:1789683323.448127:0:8459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1789683323.449200:0:8459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789683323.449247:0:8459:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789683323.449261:0:8459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcf8485587b8893e3 00000100:00080000:0.0:1789683323.449929:0:8459:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789683323.449944:0:8459:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f0fb5158000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789683323.449984:0:8459:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0f88c76300 x1876618850097408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789683323.450041:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1876618850097408:0@lo:38: 00000100:00100000:3.0:1789683323.450120:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683323.450211:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850097408 00000100:00100000:2.0:1789683323.450218:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850097408 00000100:00100000:2.0:1789683323.450248:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683323.450256:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876618850097408:12345-0@lo:38: 00010000:00080000:2.0:1789683323.450291:0:6521:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:2.0:1789683323.450354:0:6521:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcf8485587b8893ea 00000004:00100000:2.0:1789683323.450369:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789683323.450396:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9f0e810cc000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789683323.450448:0:8459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789683323.450554:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850097792:0@lo:400: 00000100:00100000:0.0:1789683323.450584:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683323.450608:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683323.450614:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850097664:0@lo:400: 00000100:00100000:0.0:1789683323.450637:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683323.451861:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850097920:0@lo:400: 00000100:00100000:1.0:1789683323.451910:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683323.451937:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683323.451943:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850097536:0@lo:400: 00000100:00100000:1.0:1789683323.451973:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683323.452000:0:6522:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789683323.452006:0:6522:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789683323.452167:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850097664 00000100:00100000:0.0:1789683323.452174:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850097664 00000100:00100000:0.0:1789683323.452206:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850097920 00000100:00100000:0.0:1789683323.452208:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850097920 00000100:00100000:0.0:1789683323.452221:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789683323.452229:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850097664:12345-0@lo:400: 00000100:00100000:0.0:1789683323.452282:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850097664:12345-0@lo:400: Request processed in 55us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683323.452289:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789683323.452346:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789683323.452353:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850097920:12345-0@lo:400: 00000100:00100000:0.0:1789683323.452399:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850097920:12345-0@lo:400: Request processed in 47us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683323.452407:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789683323.452450:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850097664:0@lo:400: 00000100:00100000:0.0:1789683323.452476:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850097920:0@lo:400: 00000100:00100000:2.0:1789683323.455956:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876618850097408:12345-0@lo:38: Request processed in 5688us (5825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683323.455971:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683323.455997:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850097792 00000100:00100000:2.0:1789683323.456006:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850097792 00000100:00100000:2.0:1789683323.456038:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850097536 00000100:00100000:2.0:1789683323.456041:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850097536 00000100:00100000:2.0:1789683323.456056:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789683323.456063:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850097792:12345-0@lo:400: 00000100:00100000:2.0:1789683323.456152:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850097792:12345-0@lo:400: Request processed in 89us (5568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683323.456158:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789683323.456180:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789683323.456187:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850097536:12345-0@lo:400: 00000100:00100000:2.0:1789683323.456225:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850097536:12345-0@lo:400: Request processed in 38us (4250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683323.456231:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789683323.456282:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0f88c76a00 x1876618850097536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683323.456306:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850097536:0@lo:400: 00010000:00080000:1.0:1789683323.456511:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0f88c77800 x1876618850097792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683323.456522:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850097792:0@lo:400: 00000020:01000004:2.0:1789683323.457855:0:8459:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789683323.457870:0:8459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9f0fb50499c0) 00000020:00000080:2.0:1789683323.457892:0:8459:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1789683323.457972:0:8459:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0fb62ea800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789683323.457975:0:8459:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0fb62ea800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789683323.457978:0:8459:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0fb62ea800 3 00010000:00080000:2.0:1789683323.458015:0:8459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0e810ca000@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.150@tcp at head 00010000:00010000:2.0:1789683323.460179:0:8459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00010000:00080000:3.0:1789683323.463483:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0f88c76300 x1876618850097408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683323.463499:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789683323.463509:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789683323.463517:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789683323.463523:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789683323.463527:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5158000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789683323.463534:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1876618850097408:0@lo:38: 00000020:00000080:2.0:1789683323.464178:0:8459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1789683323.464215:0:8459:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789683323.464225:0:8459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xcf8485587b8893f8 00000100:00080000:2.0:1789683323.464232:0:8459:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789683323.464242:0:8459:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9f0e810ca000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683323.464276:0:8459:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0f89082d80 x1876618850098048/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789683323.464338:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1876618850098048:0@lo:38: 00000100:00100000:3.0:1789683323.464402:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789683323.464460:0:8459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1789683323.464808:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1789683323.464890:0:8431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789683323.464917:0:8431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789683323.464944:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8893ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8893d5 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.464955:0:8431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8893ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8893d5 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789683323.464999:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789683323.465001:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789683323.465002:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683323.465003:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683323.465005:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683323.465006:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683323.465008:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683323.465009:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789683323.465011:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789683323.465012:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683323.465013:0:8431:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789683323.465017:0:8431:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789683323.465019:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789683323.465020:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789683323.465022:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683323.465023:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683323.465024:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683323.465025:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683323.465026:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683323.465027:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789683323.465028:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789683323.465029:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683323.465030:0:8431:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789683323.465046:0:8431:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789683323.465058:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89080380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850098176:0@lo:253: 00000100:00100000:2.0:1789683323.465098:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683323.465129:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850098176 00000100:00100000:2.0:1789683323.465136:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850098176 00000100:00100000:2.0:1789683323.465172:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789683323.465180:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:8431:x1876618850098176:12345-0@lo:253: 20000000:01000000:2.0:1789683323.465208:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789683323.465221:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789683323.465338:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683323.465481:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850098048 00000100:00100000:3.0:1789683323.465486:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850098048 00000100:00100000:3.0:1789683323.465521:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789683323.465527:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876618850098048:12345-0@lo:38: 00010000:00080000:3.0:1789683323.465553:0:6521:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:3.0:1789683323.465583:0:6521:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xcf8485587b8893ff 00000004:00100000:3.0:1789683323.465600:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789683323.465627:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9f0e81faf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683323.465687:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876618850098048:12345-0@lo:38: Request processed in 158us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683323.465695:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789683323.469454:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0f89082d80 x1876618850098048/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683323.469470:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789683323.469480:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789683323.469489:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789683323.469495:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789683323.469499:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e810ca000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789683323.469507:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1876618850098048:0@lo:38: 20000000:01000000:2.0:1789683323.481747:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789683323.481776:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789683323.482019:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789683323.482025:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789683323.482053:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0f80031a00/0xcf8485587b889406 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683323.482078:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f829e1c00/0xcf8485587b8892fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8892f5 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683323.482087:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fa01f8800/0xcf8485587b889318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889311 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683323.482096:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0f80031a00/0xcf8485587b889406 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683323.482152:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fa01f8800/0xcf8485587b889318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b889311 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683323.482169:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0fa01f8800/0xcf8485587b889318 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b889311 expref: 16 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683323.482186:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82515180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876618850098304:0@lo:104: 00000100:00100000:0.0:1789683323.482258:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789683323.482314:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f829e1c00/0xcf8485587b8892fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b8892f5 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683323.482341:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f829e1c00/0xcf8485587b8892fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b8892f5 expref: 16 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683323.482350:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82516a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876618850098432:0@lo:104: 00000100:00100000:0.0:1789683323.482371:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e810bf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683323.482481:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789683323.482501:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683323.482532:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850098304 00000100:00100000:3.0:1789683323.482540:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850098304 00000100:00100000:3.0:1789683323.482580:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850098432 00000100:00100000:3.0:1789683323.482582:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850098432 00000100:00100000:3.0:1789683323.482595:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789683323.482603:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6048c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:6537:x1876618850098304:12345-0@lo:104: 00010000:00010000:3.0:1789683323.482614:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889318 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.482680:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789683323.482686:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6048c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:6537:x1876618850098304:12345-0@lo:104: Request processed in 84us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683323.482692:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789683323.482729:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789683323.482735:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:6537:x1876618850098432:12345-0@lo:104: 00010000:00010000:3.0:1789683323.482742:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f80031c00/0xcf8485587b8892f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8892fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.482774:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789683323.482813:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:6537:x1876618850098432:12345-0@lo:104: Request processed in 77us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683323.482818:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1789683323.482837:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683323.482843:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889318 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.482850:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677e00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683323.482855:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b889318 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.482863:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b889318 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683323.482870:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b889318 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683323.482877:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683323.482905:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889311 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889318 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.482911:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683323.482929:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889311 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889318 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.482935:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889311 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889318 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.482949:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683323.482952:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f80031c00/0xcf8485587b8892f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8892fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.482968:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f80031c00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683323.482971:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80031c00/0xcf8485587b8892f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8892fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.482978:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f80031c00/0xcf8485587b8892f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8892fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683323.482983:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80031c00/0xcf8485587b8892f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8892fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683323.482987:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683323.482998:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f80031c00/0xcf8485587b8892f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8892fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.483003:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683323.483016:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f80031c00/0xcf8485587b8892f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8892fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.483023:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f80031c00/0xcf8485587b8892f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8892fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.483036:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683323.483037:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683323.483038:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683323.483058:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850098560:0@lo:103: 00000100:00100000:3.0:1789683323.483086:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683323.483113:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850098688:0@lo:103: 00000100:00100000:3.0:1789683323.483132:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683323.483168:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850098560 00000100:00100000:3.0:1789683323.483172:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850098560 00010000:00010000:3.0:1789683323.483189:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fa01f8800/0xcf8485587b889318 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889311 expref: 17 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683323.483205:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850098688 00000100:00100000:3.0:1789683323.483207:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850098688 00010000:00010000:3.0:1789683323.483215:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f829e1c00/0xcf8485587b8892fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8892f5 expref: 18 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683323.483224:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789683323.483229:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:3648:x1876618850098560:12345-0@lo:103: 00010000:00010000:3.0:1789683323.483237:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683323.483241:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fa01f8800/0xcf8485587b889318 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889311 expref: 18 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.483250:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fa01f8800/0xcf8485587b889318 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b889311 expref: 18 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.483263:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683323.483290:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:3648:x1876618850098560:12345-0@lo:103: Request processed in 61us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683323.483309:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789683323.483322:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789683323.483328:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:3649:x1876618850098688:12345-0@lo:103: 00010000:00010000:3.0:1789683323.483336:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683323.483340:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f829e1c00/0xcf8485587b8892fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8892f5 expref: 17 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.483348:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f829e1c00/0xcf8485587b8892fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b8892f5 expref: 17 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.483366:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0f80031a00/0xcf8485587b889406 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.483374:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f80031a00/0xcf8485587b889406 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789683323.483387:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012087750s 00010000:00010000:3.0:1789683323.483392:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0f80031a00/0xcf8485587b889406 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.483398:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0f80031a00/0xcf8485587b889406 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.483404:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0f80031a00/0xcf8485587b889406 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.483410:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0f80031a00/0xcf8485587b889406 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.483415:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f80031a00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683323.483419:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0f80031a00/0xcf8485587b889406 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.483426:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0f80031a00/0xcf8485587b889406 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.483434:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0f80031a00/0xcf8485587b889406 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683323.483443:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683323.483469:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:3649:x1876618850098688:12345-0@lo:103: Request processed in 142us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683323.483480:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789683323.483511:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850098688:0@lo:103: 00000100:00100000:3.0:1789683323.483531:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850098560:0@lo:103: 00010000:00010000:1.0:1789683323.483605:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683323.483995:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f8800/0xcf8485587b889318 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b889311 expref: 16 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683323.484007:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82515180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876618850098304:0@lo:104: 00010000:00010000:2.0:1789683323.484017:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f829e1c00/0xcf8485587b8892fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b8892f5 expref: 15 pid: 6516 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683323.484024:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82516a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876618850098432:0@lo:104: 00010000:00010000:2.0:1789683323.484039:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0f80031a00/0xcf8485587b889406 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.484049:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0f80031a00/0xcf8485587b889406 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.484055:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0f80031a00/0xcf8485587b889406 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683323.484069:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f80031a00/0xcf8485587b889406 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683323.484179:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:8431:x1876618850098176:12345-0@lo:253: Request processed in 18998us (19079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683323.484188:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789683323.484262:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89080380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8431:1876618850098176:0@lo:253: 10000000:01000000:2.0:1789683323.484272:0:8431:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789683323.484274:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789683323.484276:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789683323.484277:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683323.484278:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683323.484279:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683323.484280:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683323.484282:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683323.484283:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789683323.484285:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789683323.484286:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683323.484287:0:8431:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789683323.484307:0:8431:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789683323.491034:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683323.491061:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850098816:0@lo:41: 00000100:00100000:1.0:1789683323.491128:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683323.491235:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850098816 00000100:00100000:0.0:1789683323.491244:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850098816 00000100:00100000:0.0:1789683323.491307:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789683323.491317:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850098816:12345-0@lo:41: 00000004:00000024:0.0:1789683323.491352:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1789683323.491408:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850098816:12345-0@lo:41: Request processed in 92us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683323.491414:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789683323.491491:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850098816:0@lo:41: 00080000:10000000:2.0:1789683323.493111:0:8431:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789683323.493264:0:8431:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789683323.493474:0:8431:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789683323.493616:0:8431:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789683323.496236:0:8431:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789683323.496575:0:8431:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1789683323.503504:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789683323.535044:0:8431:0:(ofd_obd.c:547:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789683323.535055:0:8431:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789683323.535096:0:8431:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789683323.535148:0:8431:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789683323.535171:0:8431:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789683323.535194:0:8431:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789683323.536139:0:8431:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789683323.536387:0:8431:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789683323.938981:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789683324.951073:0:8516:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789683324.951262:0:8516:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789683324.958969:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683325.992988:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683327.010142:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683327.592241:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683327.592268:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850098944:0@lo:41: 00000100:00100000:1.0:1789683327.592343:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683327.592481:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850098944 00000100:00100000:2.0:1789683327.592489:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850098944 00000100:00100000:2.0:1789683327.592540:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789683327.592549:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850098944:12345-0@lo:41: 00000004:00000024:2.0:1789683327.592594:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789683327.592646:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850098944:12345-0@lo:41: Request processed in 98us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683327.592653:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789683327.592754:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850098944:0@lo:41: 00010000:00010000:1.0:1789683328.030961:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789683328.096852:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789683328.096862:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0f88c59000 from 30 10000000:01000000:1.0:1789683328.096868:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789683328.096921:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b88940d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683328.096932:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b88940d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683328.096943:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b88940d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683328.096980:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850099072:0@lo:101: 00000100:00100000:1.0:1789683328.097059:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683328.097135:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f905753c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683328.097223:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850099072 00000100:00100000:2.0:1789683328.097231:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850099072 00000100:00100000:2.0:1789683328.097285:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789683328.097297:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:6518:x1876618850099072:12345-0@lo:101: 00010000:00010000:2.0:1789683328.097314:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683328.097328:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b889414 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88940d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.097354:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b889414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88940d expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.097366:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b889414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88940d expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.097374:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f9c00, rc 0) 00000100:00100000:2.0:1789683328.097424:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:6518:x1876618850099072:12345-0@lo:101: Request processed in 130us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683328.097431:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789683328.097521:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850099072:0@lo:101: 00010000:00010000:1.0:1789683328.097535:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b88940d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889414 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683328.097544:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b88940d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889414 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683328.097601:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850099200:0@lo:501: 00000100:00100000:1.0:1789683328.097628:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683328.097650:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f905753c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683328.097701:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850099200 00000100:00100000:2.0:1789683328.097707:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850099200 00000100:00100000:2.0:1789683328.097747:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789683328.097754:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:6518:x1876618850099200:12345-0@lo:501: 00000100:00100000:2.0:1789683328.097892:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:6518:x1876618850099200:12345-0@lo:501: Request processed in 138us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683328.097909:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789683328.097937:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850099200:0@lo:501: 00000100:00100000:2.0:1789683328.097963:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850099328:0@lo:503: 00000100:00100000:2.0:1789683328.098000:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683328.098012:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f857eed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683328.098023:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850099328 00000100:00100000:2.0:1789683328.098026:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850099328 00000100:00100000:2.0:1789683328.098041:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789683328.098046:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:6518:x1876618850099328:12345-0@lo:503: 00000100:00100000:2.0:1789683328.098116:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:6518:x1876618850099328:12345-0@lo:503: Request processed in 69us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683328.098124:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789683328.098158:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850099328:0@lo:503: 00000100:00100000:2.0:1789683328.098335:0:8668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8668:1876618850099456:0@lo:502: 00000100:00100000:2.0:1789683328.098367:0:8668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683328.098384:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850099456 00000100:00100000:2.0:1789683328.098387:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850099456 00000100:00100000:2.0:1789683328.098402:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789683328.098408:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:8668:x1876618850099456:12345-0@lo:502: 00000100:00100000:2.0:1789683328.098470:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:8668:x1876618850099456:12345-0@lo:502: Request processed in 62us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683328.098478:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789683328.098500:0:8668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f857ee900 going to sleep for 11 seconds 00000100:00100000:2.0:1789683328.098511:0:8668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8668:1876618850099456:0@lo:502: 00000100:00100000:2.0:1789683328.098552:0:8668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8668:1876618850099584:0@lo:502: 00000100:00100000:2.0:1789683328.098580:0:8668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683328.098596:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850099584 00000100:00100000:2.0:1789683328.098599:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850099584 00000100:00100000:2.0:1789683328.098614:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789683328.098619:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:8668:x1876618850099584:12345-0@lo:502: 00000100:00100000:2.0:1789683328.098670:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:8668:x1876618850099584:12345-0@lo:502: Request processed in 50us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683328.098676:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789683328.098698:0:8668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f857ee900 going to sleep for 11 seconds 00000100:00100000:2.0:1789683328.098708:0:8668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8668:1876618850099584:0@lo:502: 00000040:00080000:2.0:1789683328.098724:0:8668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789683328.098770:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789683328.098805:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789683328.098812:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b88940d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889414 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.098822:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b88940d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889414 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683328.098830:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789683328.098833:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0f88c59000 from 5 10000000:01000000:2.0:1789683328.098835:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789683328.098855:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88941b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.098863:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88941b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.098882:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88941b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683328.098893:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850099712:0@lo:101: 00000100:00100000:2.0:1789683328.098917:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683328.098931:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f857ee900 going to sleep for 11 seconds 00000100:00100000:2.0:1789683328.098943:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850099712 00000100:00100000:2.0:1789683328.098947:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850099712 00000100:00100000:2.0:1789683328.098962:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789683328.098967:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:6518:x1876618850099712:12345-0@lo:101: 00010000:00010000:2.0:1789683328.098974:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683328.098984:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f9800/0xcf8485587b889422 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88941b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.099000:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f9800/0xcf8485587b889422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88941b expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.099009:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f9800/0xcf8485587b889422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88941b expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.099018:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f9800, rc 0) 00000100:00100000:2.0:1789683328.099042:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850099712:12345-0@lo:101: Request processed in 74us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683328.099048:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789683328.099071:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850099712:0@lo:101: 00010000:00010000:2.0:1789683328.099082:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88941b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889422 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.099100:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88941b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889422 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683328.099136:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850099840:0@lo:256: 00000100:00100000:2.0:1789683328.099163:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683328.099174:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f857ee900 going to sleep for 11 seconds 00000100:00100000:2.0:1789683328.099185:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850099840 00000100:00100000:2.0:1789683328.099188:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850099840 00000100:00100000:2.0:1789683328.099203:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789683328.099209:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850099840:12345-0@lo:256: 20000000:01000000:2.0:1789683328.099235:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789683328.099252:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789683328.099255:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789683328.099323:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850099840:12345-0@lo:256: Request processed in 114us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683328.099330:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789683328.099355:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850099840:0@lo:256: 10000000:01000000:2.0:1789683328.099390:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789683328.099395:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88941b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889422 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.099402:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88941b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889422 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683328.099409:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789683328.099411:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1789683328.099413:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789683328.099430:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.099438:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.099446:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683328.099456:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850099968:0@lo:101: 00000100:00100000:2.0:1789683328.099478:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683328.099490:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f857ee900 going to sleep for 11 seconds 00000100:00100000:2.0:1789683328.099501:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850099968 00000100:00100000:2.0:1789683328.099504:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850099968 00000100:00100000:2.0:1789683328.099519:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789683328.099524:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850099968:12345-0@lo:101: 00010000:00010000:2.0:1789683328.099531:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683328.099539:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f9400/0xcf8485587b889430 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889429 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.099551:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f9400/0xcf8485587b889430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889429 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.099558:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f9400/0xcf8485587b889430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889429 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.099564:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f9400, rc 0) 00000100:00100000:2.0:1789683328.099589:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850099968:12345-0@lo:101: Request processed in 65us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683328.099594:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789683328.099630:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850099968:0@lo:101: 00010000:00010000:2.0:1789683328.099639:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889429 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889430 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.099647:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889429 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889430 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683328.099686:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850100096:0@lo:501: 00000100:00100000:2.0:1789683328.099708:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683328.099720:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f857ee900 going to sleep for 11 seconds 00000100:00100000:2.0:1789683328.099731:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850100096 00000100:00100000:2.0:1789683328.099734:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850100096 00000100:00100000:2.0:1789683328.099749:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789683328.099754:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850100096:12345-0@lo:501: 00000100:00100000:2.0:1789683328.099866:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850100096:12345-0@lo:501: Request processed in 111us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683328.099872:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789683328.099898:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850100096:0@lo:501: 00000100:00100000:2.0:1789683328.099920:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850100224:0@lo:503: 00000100:00100000:2.0:1789683328.099957:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683328.099968:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f857ee900 going to sleep for 11 seconds 00000100:00100000:2.0:1789683328.099979:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850100224 00000100:00100000:2.0:1789683328.099982:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850100224 00000100:00100000:2.0:1789683328.099998:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789683328.100003:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850100224:12345-0@lo:503: 00000100:00100000:2.0:1789683328.100071:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850100224:12345-0@lo:503: Request processed in 67us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683328.100085:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789683328.100118:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850100224:0@lo:503: 00000100:00100000:0.0:1789683328.105632:0:8669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82516300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8669:1876618850100352:0@lo:502: 00000100:00100000:0.0:1789683328.105716:0:8669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683328.105764:0:8669:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c210000 going to sleep for 11 seconds 00000100:00100000:2.0:1789683328.106917:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850100352 00000100:00100000:2.0:1789683328.106929:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850100352 00000100:00100000:2.0:1789683328.106988:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789683328.106997:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:8669:x1876618850100352:12345-0@lo:502: 00000100:00100000:2.0:1789683328.107165:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:8669:x1876618850100352:12345-0@lo:502: Request processed in 168us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683328.107172:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789683328.107285:0:8669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82516300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8669:1876618850100352:0@lo:502: 00000020:01000000:0.0:1789683328.107317:0:8669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789683328.107324:0:8669:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789683328.107331:0:8669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683328.107333:0:8669:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789683328.107337:0:8669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789683328.107341:0:8669:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:0.0:1789683328.107370:0:8669:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789683328.107373:0:8669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789683328.107388:0:8669:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9f0e82408000) 00000020:00000080:0.0:1789683328.107410:0:8669:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1789683328.107417:0:8669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789683328.107502:0:8669:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789683328.107509:0:8669:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789683328.107515:0:8669:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf8485587b88943e 00010000:00080000:0.0:1789683328.107542:0:8669:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0fc17f1800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:0.0:1789683328.107757:0:8669:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1789683328.120312:0:8669:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789683328.120342:0:8669:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789683328.120570:0:8669:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683328.120851:0:8669:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683328.120943:0:8669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789683328.121029:0:8669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789683328.122896:0:8670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789683328.122904:0:8670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789683328.125529:0:8669:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789683328.125544:0:8669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789683328.125591:0:8669:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789683328.125619:0:8669:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b889445 00000100:00080000:0.0:1789683328.125631:0:8669:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789683328.125644:0:8669:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f0fc17f1800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789683328.125696:0:8669:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e82516300 x1876618850100480/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789683328.125729:0:8669:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789683328.125823:0:8669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683328.125828:0:8669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683328.125830:0:8669:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789683328.125847:0:8669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683328.125853:0:8669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683328.125854:0:8669:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789683328.125858:0:8669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789683328.125860:0:8669:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789683328.125890:0:8669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82514380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8669:1876618850100608:0@lo:502: 00000100:00100000:0.0:1789683328.125973:0:8669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683328.126006:0:8669:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683328.126230:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850100608 00000100:00100000:1.0:1789683328.126238:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850100608 00000100:00100000:3.0:1789683328.126316:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850100480:0@lo:8: 00000100:00100000:3.0:1789683328.126354:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683328.126387:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850100864:0@lo:400: 00000100:00100000:3.0:1789683328.126412:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683328.126429:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850101376:0@lo:400: 00000100:00100000:3.0:1789683328.126451:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683328.126467:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683328.126473:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850100992:0@lo:400: 00000100:00100000:3.0:1789683328.126492:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683328.126519:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850100864 00000100:00100000:3.0:1789683328.126523:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850100864 00000100:00100000:3.0:1789683328.126554:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789683328.126562:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850100864:12345-0@lo:400: 00000100:00100000:3.0:1789683328.126628:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850100864:12345-0@lo:400: Request processed in 66us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683328.126635:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789683328.126659:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850101376 00000100:00100000:3.0:1789683328.126663:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850101376 00000100:00100000:3.0:1789683328.126689:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850100992 00000100:00100000:3.0:1789683328.126692:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850100992 00000100:00100000:3.0:1789683328.126708:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789683328.126714:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850101376:12345-0@lo:400: 00000100:00100000:3.0:1789683328.126746:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850101376:12345-0@lo:400: Request processed in 33us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683328.126751:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789683328.126762:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683328.126767:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850100992:12345-0@lo:400: 00000100:00100000:3.0:1789683328.126825:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850100992:12345-0@lo:400: Request processed in 58us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683328.126830:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789683328.126866:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e81d41180 x1876618850100992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683328.126880:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850100992:0@lo:400: 00000100:00100000:3.0:1789683328.126890:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850100864:0@lo:400: 00010000:00080000:3.0:1789683328.126898:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e81d42a00 x1876618850101376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683328.126906:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850101376:0@lo:400: 00000100:00080000:3.0:1789683328.126928:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789683328.127027:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850100736:0@lo:400: 00000100:00100000:0.0:1789683328.127055:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683328.127081:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850101248:0@lo:400: 00000100:00100000:0.0:1789683328.127104:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683328.127119:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683328.127125:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850101120:0@lo:400: 00000100:00100000:0.0:1789683328.127145:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683328.127170:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850100736 00000100:00100000:0.0:1789683328.127174:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850100736 00000100:00100000:0.0:1789683328.127194:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850101248 00000100:00100000:0.0:1789683328.127197:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850101248 00000100:00100000:0.0:1789683328.127226:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789683328.127232:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850100736:12345-0@lo:400: 00000100:00100000:0.0:1789683328.127267:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850100736:12345-0@lo:400: Request processed in 36us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.127273:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789683328.127287:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789683328.127292:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850101248:12345-0@lo:400: 00000100:00100000:0.0:1789683328.127316:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850101248:12345-0@lo:400: Request processed in 25us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.127331:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789683328.127350:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850101120 00000100:00100000:0.0:1789683328.127354:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850101120 00000100:00100000:0.0:1789683328.127372:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789683328.127377:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850101120:12345-0@lo:400: 00000100:00100000:0.0:1789683328.127406:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850101120:12345-0@lo:400: Request processed in 29us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.127412:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789683328.127434:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850101120:0@lo:400: 00010000:00080000:0.0:1789683328.127443:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e81d41c00 x1876618850100736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683328.127451:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850100736:0@lo:400: 00010000:00080000:0.0:1789683328.127459:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e81d42680 x1876618850101248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683328.127467:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850101248:0@lo:400: 00000100:00080000:3.0:1789683328.127621:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683328.129830:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789683328.129852:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:8669:x1876618850100608:12345-0@lo:502: 00000100:00100000:1.0:1789683328.130033:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:8669:x1876618850100608:12345-0@lo:502: Request processed in 190us (4059us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683328.130042:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789683328.130100:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850100480 00000100:00100000:1.0:1789683328.130107:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850100480 00000100:00100000:1.0:1789683328.130134:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683328.130140:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1876618850100480:12345-0@lo:8: 00010000:00080000:1.0:1789683328.130163:0:8437:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:1.0:1789683328.130196:0:8437:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b88944c 00002000:00100000:1.0:1789683328.130252:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9f0fc06b7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789683328.130257:0:8437:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1789683328.130261:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789683328.130322:0:8437:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789683328.130560:0:8437:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789683328.130588:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9f0f88c6f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683328.130635:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1876618850100480:12345-0@lo:8: Request processed in 494us (4280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683328.130642:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789683328.130701:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e82516300 x1876618850100480/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789683338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683328.130712:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789683328.130719:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789683328.130727:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789683328.130733:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789683328.130735:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc17f1800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789683328.130743:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789683328.130748:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850100480:0@lo:8: 00000004:00080000:0.0:1789683328.131017:0:8670:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789683328.131076:0:8670:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 242180291673ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789683328.131083:0:8670:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789683328.131127:0:8669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82514380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8669:1876618850100608:0@lo:502: 00000020:01000000:0.0:1789683328.131161:0:8669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683328.131168:0:8669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683328.131170:0:8669:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789683328.131175:0:8669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1789683328.131438:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1789683328.131463:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789683328.131473:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889429 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889430 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.131484:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889430 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683328.131494:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789683328.131496:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0f8bdba800 from 30 10000000:01000000:2.0:1789683328.131499:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789683328.131529:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889453 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.131537:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889453 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.131545:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889453 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683328.131575:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850101504:0@lo:101: 00000100:00100000:2.0:1789683328.131623:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683328.132020:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f857eed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683328.133370:0:8671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8671:1876618850101632:0@lo:700: 00000100:00100000:3.0:1789683328.133427:0:8671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683328.133459:0:8671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc0775240 going to sleep for 11 seconds 00000100:00100000:1.0:1789683328.134943:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850101632 00000100:00100000:1.0:1789683328.134957:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850101632 00000100:00100000:1.0:1789683328.135426:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683328.135438:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8671:x1876618850101632:12345-0@lo:700: 00000100:00100000:1.0:1789683328.135493:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d41500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8446:1876618850101760:0@lo:700: 00000100:00100000:1.0:1789683328.135550:0:8446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683328.135573:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f90575840 going to sleep for 11 seconds 00000100:00080000:1.0:1789683328.135590:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683328.135602:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850101760 00000100:00100000:1.0:1789683328.135613:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850101760 00000100:00100000:1.0:1789683328.135640:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683328.135646:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8446:x1876618850101760:12345-0@lo:700: 00000100:00100000:0.0:1789683328.136622:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850101504 00000100:00100000:0.0:1789683328.136631:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850101504 00000004:00080000:3.0:1789683328.136816:0:7455:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789683328.136937:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789683328.136946:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850101504:12345-0@lo:101: 00010000:00010000:0.0:1789683328.136958:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683328.136978:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f80031200/0xcf8485587b88945a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889453 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.137906:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f80031200/0xcf8485587b88945a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889453 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.137923:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f80031200/0xcf8485587b88945a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889453 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.137934:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f80031200, rc 0) 00000100:00100000:0.0:1789683328.138087:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850101504:12345-0@lo:101: Request processed in 1141us (6462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.138094:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789683328.138195:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850101504:0@lo:101: 00010000:00010000:3.0:1789683328.138226:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889453 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88945a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683328.138236:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889453 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88945a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683328.138312:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850101888:0@lo:501: 00000100:00100000:3.0:1789683328.138349:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683328.138387:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07750c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683328.138470:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850101888 00000100:00100000:0.0:1789683328.138477:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850101888 00000100:00100000:0.0:1789683328.138517:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789683328.138524:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850101888:12345-0@lo:501: 00000100:00100000:0.0:1789683328.138654:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850101888:12345-0@lo:501: Request processed in 129us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.138661:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789683328.138824:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850101888:0@lo:501: 00000100:00100000:1.0:1789683328.138871:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850102016:0@lo:503: 00000100:00100000:1.0:1789683328.138906:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683328.141443:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f905753c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683328.142764:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850102016 00000100:00100000:3.0:1789683328.142778:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850102016 00000100:00100000:3.0:1789683328.142875:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789683328.142885:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850102016:12345-0@lo:503: 00000100:00100000:3.0:1789683328.143119:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850102016:12345-0@lo:503: Request processed in 235us (4212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683328.143127:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789683328.143867:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850102016:0@lo:503: 00000100:00100000:0.0:1789683328.144307:0:8672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82514380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8672:1876618850102144:0@lo:502: 00000100:00100000:0.0:1789683328.144358:0:8672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683328.144396:0:8672:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510e000 going to sleep for 11 seconds 00000100:00100000:3.0:1789683328.144449:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850102144 00000100:00100000:3.0:1789683328.144454:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850102144 00000100:00100000:3.0:1789683328.144492:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789683328.144499:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:8672:x1876618850102144:12345-0@lo:502: 00000100:00100000:3.0:1789683328.144596:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:8672:x1876618850102144:12345-0@lo:502: Request processed in 97us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683328.144613:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789683328.144764:0:8672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82514380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8672:1876618850102144:0@lo:502: 00000100:00100000:0.0:1789683328.144838:0:8672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82514380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8672:1876618850102272:0@lo:502: 00000100:00100000:0.0:1789683328.144872:0:8672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683328.144885:0:8672:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510e000 going to sleep for 11 seconds 00000100:00100000:3.0:1789683328.145237:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850102272 00000100:00100000:3.0:1789683328.145242:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850102272 00000100:00100000:3.0:1789683328.145307:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789683328.145315:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:8672:x1876618850102272:12345-0@lo:502: 00000100:00100000:3.0:1789683328.145395:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:8672:x1876618850102272:12345-0@lo:502: Request processed in 81us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683328.145401:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789683328.147601:0:8672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82514380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8672:1876618850102272:0@lo:502: 00000040:00080000:1.0:1789683328.147646:0:8672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 40000000:02000000:1.0:1789683328.148827:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000020:01000000:3.0:1789683328.152967:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789683328.153006:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789683328.153020:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889453 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88945a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683328.153033:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88945a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683328.153044:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789683328.153048:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0f8bdba800 from 5 10000000:01000000:3.0:1789683328.153051:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789683328.153091:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b889461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683328.153099:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b889461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683328.153111:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b889461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683328.153135:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850102400:0@lo:101: 00000100:00100000:3.0:1789683328.153209:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683328.153267:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc0775e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683328.153340:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850102400 00000100:00100000:0.0:1789683328.153348:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850102400 00000100:00100000:0.0:1789683328.153399:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789683328.153409:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850102400:12345-0@lo:101: 00010000:00010000:0.0:1789683328.153422:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683328.153433:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f80030c00/0xcf8485587b889468 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889461 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.153459:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f80030c00/0xcf8485587b889468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889461 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.153471:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f80030c00/0xcf8485587b889468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889461 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.153479:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f80030c00, rc 0) 00000100:00100000:0.0:1789683328.153526:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+19:6518:x1876618850102400:12345-0@lo:101: Request processed in 117us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.153532:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789683328.153575:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850102400:0@lo:101: 00010000:00010000:0.0:1789683328.153588:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b889461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889468 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.153596:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b889461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889468 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683328.153654:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850102528:0@lo:256: 00000100:00100000:0.0:1789683328.154774:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683328.154815:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510e000 going to sleep for 11 seconds 00000100:00100000:0.0:1789683328.154841:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850102528 00000100:00100000:0.0:1789683328.154848:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850102528 00000100:00100000:0.0:1789683328.154882:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789683328.154890:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+19:6518:x1876618850102528:12345-0@lo:256: 20000000:01000000:0.0:1789683328.154908:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789683328.154929:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789683328.154932:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789683328.155017:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+19:6518:x1876618850102528:12345-0@lo:256: Request processed in 128us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.155024:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789683328.155064:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850102528:0@lo:256: 10000000:01000000:0.0:1789683328.155108:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789683328.155117:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b889461 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889468 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.155129:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b889461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889468 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683328.155138:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789683328.155141:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789683328.155143:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789683328.155171:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80031400/0xcf8485587b88946f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.155188:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f80031400/0xcf8485587b88946f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.155197:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f80031400/0xcf8485587b88946f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683328.155225:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850102656:0@lo:101: 00000100:00100000:0.0:1789683328.155257:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683328.155271:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510e000 going to sleep for 11 seconds 00000100:00100000:0.0:1789683328.155283:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850102656 00000100:00100000:0.0:1789683328.155286:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850102656 00000100:00100000:0.0:1789683328.155308:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789683328.155314:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+19:6518:x1876618850102656:12345-0@lo:101: 00010000:00010000:0.0:1789683328.155321:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683328.155333:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f80031c00/0xcf8485587b889476 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88946f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.155352:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f80031c00/0xcf8485587b889476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88946f expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.155362:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f80031c00/0xcf8485587b889476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88946f expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.155370:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f80031c00, rc 0) 00000100:00100000:0.0:1789683328.155396:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850102656:12345-0@lo:101: Request processed in 83us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.155402:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789683328.155429:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850102656:0@lo:101: 00010000:00010000:0.0:1789683328.155446:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f80031400/0xcf8485587b88946f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889476 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.155455:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f80031400/0xcf8485587b88946f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889476 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683328.155505:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850102784:0@lo:501: 00000100:00100000:0.0:1789683328.155528:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683328.155539:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510e000 going to sleep for 11 seconds 00000100:00100000:0.0:1789683328.155550:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850102784 00000100:00100000:0.0:1789683328.155553:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850102784 00000100:00100000:0.0:1789683328.155572:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789683328.155577:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850102784:12345-0@lo:501: 00000100:00100000:0.0:1789683328.155685:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850102784:12345-0@lo:501: Request processed in 107us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.155691:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789683328.155722:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850102784:0@lo:501: 00000100:00100000:0.0:1789683328.155747:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850102912:0@lo:503: 00000100:00100000:0.0:1789683328.155807:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683328.155820:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510e000 going to sleep for 11 seconds 00000100:00100000:0.0:1789683328.155831:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850102912 00000100:00100000:0.0:1789683328.155834:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850102912 00000100:00100000:0.0:1789683328.155855:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789683328.155860:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850102912:12345-0@lo:503: 00000100:00100000:0.0:1789683328.155934:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850102912:12345-0@lo:503: Request processed in 73us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.155941:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789683328.155983:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850102912:0@lo:503: 00000100:00100000:0.0:1789683328.156158:0:8673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82514000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8673:1876618850103040:0@lo:502: 00000100:00100000:0.0:1789683328.156195:0:8673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683328.156225:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850103040 00000100:00100000:0.0:1789683328.156229:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850103040 00000100:00100000:0.0:1789683328.156251:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789683328.156256:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:8673:x1876618850103040:12345-0@lo:502: 00000100:00100000:0.0:1789683328.156325:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:8673:x1876618850103040:12345-0@lo:502: Request processed in 69us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.156332:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789683328.156361:0:8673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f890e2000 going to sleep for 11 seconds 00000100:00100000:0.0:1789683328.156372:0:8673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82514000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8673:1876618850103040:0@lo:502: 00000020:01000000:0.0:1789683328.156393:0:8673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789683328.156400:0:8673:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789683328.156406:0:8673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683328.156409:0:8673:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789683328.156414:0:8673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789683328.156417:0:8673:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:0.0:1789683328.156440:0:8673:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789683328.156443:0:8673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789683328.156457:0:8673:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9f0e8240cd40) 00000020:00000080:0.0:1789683328.156478:0:8673:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1789683328.156483:0:8673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789683328.156550:0:8673:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789683328.156556:0:8673:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789683328.156562:0:8673:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b889484 00010000:00080000:0.0:1789683328.156589:0:8673:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0fc17f3800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00010000:0.0:1789683328.156836:0:8673:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:1.0:1789683328.163751:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8446:x1876618850101760:12345-0@lo:700: Request processed in 28097us (28192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683328.163766:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789683328.163861:0:8446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e81d41500 x1876618850101760/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789683344 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683328.163877:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d41500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8446:1876618850101760:0@lo:700: 40000000:02000000:1.0:1789683328.163889:0:8446:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:0.0:1789683328.172121:0:8673:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789683328.172148:0:8673:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789683328.172369:0:8673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683328.172543:0:8673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683328.172629:0:8673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789683328.173882:0:8673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000001:00100000:1.0:1789683328.180286:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789683328.180423:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8671:x1876618850101632:12345-0@lo:700: Request processed in 44982us (46990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683328.180438:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789683328.180609:0:8671:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb61f2680 x1876618850101632/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789683344 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683328.180627:0:8671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8671:1876618850101632:0@lo:700: 00000040:00080000:3.0:1789683328.180854:0:8674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789683328.180860:0:8674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789683328.182517:0:8673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789683328.182533:0:8673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789683328.182570:0:8673:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789683328.182597:0:8673:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b88948b 00000100:00080000:3.0:1789683328.182607:0:8673:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683328.182618:0:8673:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f0fc17f3800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683328.182656:0:8673:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb61f2680 x1876618850103168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683328.182805:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850103168:0@lo:8: 00000100:00100000:1.0:1789683328.182874:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789683328.182955:0:8673:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789683328.183031:0:8673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683328.183036:0:8673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683328.183038:0:8673:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789683328.183041:0:8673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683328.183045:0:8673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683328.183047:0:8673:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789683328.183050:0:8673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789683328.183052:0:8673:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789683328.183076:0:8673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8673:1876618850103296:0@lo:502: 00000100:00100000:3.0:1789683328.183120:0:8673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683328.183145:0:8673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc0775c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683328.183168:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850103168 00000100:00100000:3.0:1789683328.183180:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850103168 00000100:00100000:3.0:1789683328.183223:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683328.183230:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1876618850103168:12345-0@lo:8: 00010000:00080000:3.0:1789683328.183253:0:8440:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:3.0:1789683328.183277:0:8440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b889492 00002000:00100000:3.0:1789683328.183291:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9f0e81fac000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789683328.183296:0:8440:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789683328.183299:0:8440:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789683328.183378:0:8440:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789683328.183401:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9f0e81fac800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683328.186425:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850103296 00000100:00100000:0.0:1789683328.186443:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850103296 00000100:00100000:0.0:1789683328.186507:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789683328.186517:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:8673:x1876618850103296:12345-0@lo:502: 00000100:00100000:0.0:1789683328.186695:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:8673:x1876618850103296:12345-0@lo:502: Request processed in 179us (3574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.186703:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789683328.186773:0:8673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:8673:1876618850103296:0@lo:502: 00000020:01000000:0.0:1789683328.186826:0:8673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683328.186833:0:8673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683328.186835:0:8673:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789683328.186839:0:8673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1789683328.186969:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789683328.186989:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789683328.187000:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80031400/0xcf8485587b88946f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889476 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.187011:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f80031400/0xcf8485587b88946f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889476 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683328.187021:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789683328.187023:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f0fa508b380 from 1 10000000:01000000:0.0:1789683328.187026:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789683328.187060:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b889499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.187075:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b889499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.187085:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b889499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683328.187104:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850103424:0@lo:101: 00000100:00100000:0.0:1789683328.187140:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683328.187169:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f890e2000 going to sleep for 11 seconds 00000100:00100000:0.0:1789683328.187185:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850103424 00000100:00100000:0.0:1789683328.187189:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850103424 00000100:00100000:0.0:1789683328.187225:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789683328.187232:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850103424:12345-0@lo:101: 00010000:00010000:0.0:1789683328.187242:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683328.187256:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81390c00/0xcf8485587b8894a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889499 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.187287:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81390c00/0xcf8485587b8894a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889499 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.187300:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81390c00/0xcf8485587b8894a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889499 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.187308:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81390c00, rc 0) 00000100:00100000:0.0:1789683328.187338:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850103424:12345-0@lo:101: Request processed in 107us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.187344:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789683328.187376:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850103424:0@lo:101: 00010000:00010000:0.0:1789683328.187396:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b889499 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8894a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.187404:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b889499 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8894a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683328.187450:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850103552:0@lo:501: 00000100:00100000:0.0:1789683328.187475:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683328.187487:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f890e2000 going to sleep for 11 seconds 00000100:00100000:0.0:1789683328.187502:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850103552 00000100:00100000:0.0:1789683328.187506:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850103552 00000100:00100000:0.0:1789683328.187526:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789683328.187532:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850103552:12345-0@lo:501: 00000100:00100000:0.0:1789683328.187596:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850103552:12345-0@lo:501: Request processed in 63us (120us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789683328.187603:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789683328.187631:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850103552:0@lo:501: 10000000:01000000:0.0:1789683328.187649:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789683328.187654:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b889499 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8894a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.187663:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b889499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8894a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683328.193826:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876618850103168:12345-0@lo:8: Request processed in 10584us (10941us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683328.193840:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789683328.193997:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb61f2680 x1876618850103168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789683338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683328.194030:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789683328.194040:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789683328.194048:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789683328.194054:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789683328.194057:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc17f3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789683328.194075:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789683328.194080:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850103168:0@lo:8: 00000004:00080000:3.0:1789683328.194157:0:8674:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789683328.194243:0:8674:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 242243458992ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789683328.194249:0:8674:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789683328.196979:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789683328.198561:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850103680:0@lo:13: 00000100:00100000:3.0:1789683328.198649:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683328.198767:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850103680 00000100:00100000:1.0:1789683328.198776:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850103680 00000100:00100000:1.0:1789683328.198844:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683328.198853:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850103680:12345-0@lo:13: 00002000:00000024:1.0:1789683328.198881:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000004:00080000:0.0:1789683328.199906:0:8671:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789683328.199943:0:8671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82517480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8671:1876618850103808:0@lo:7: 00000100:00100000:0.0:1789683328.202855:0:8671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683328.202922:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850103808 00000100:00100000:0.0:1789683328.202932:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850103808 00000100:00100000:0.0:1789683328.202983:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683328.202994:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8671:x1876618850103808:12345-0@lo:7: 00000100:00100000:1.0:1789683328.203818:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1876618850103680:12345-0@lo:13: Request processed in 4963us (5166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683328.203830:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789683328.203960:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e82514000 x1876618850103680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683328.203983:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850103680:0@lo:13: 00000004:00080000:1.0:1789683328.205521:0:8675:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789683328.205548:0:8675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d42680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8675:1876618850104064:0@lo:7: 00000100:00100000:1.0:1789683328.205609:0:8675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683328.205683:0:8675:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f90575b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789683328.209516:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850103936:0@lo:13: 00000100:00100000:1.0:1789683328.209604:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1789683328.214535:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789683328.214544:0:8439:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789683328.214633:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8671:x1876618850103808:12345-0@lo:7: Request processed in 11636us (11780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.214644:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683328.214674:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850104064 00000100:00100000:0.0:1789683328.214681:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850104064 00000100:00100000:3.0:1789683328.214905:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789683328.214916:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8675:x1876618850104064:12345-0@lo:7: 00002000:00080000:3.0:1789683328.218184:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789683328.218192:0:8440:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789683328.218428:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8675:x1876618850104064:12345-0@lo:7: Request processed in 3510us (12814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683328.218443:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789683328.218525:0:8675:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e81d42680 x1876618850104064/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789683344 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683328.218538:0:8675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d42680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8675:1876618850104064:0@lo:7: 00000004:00080000:3.0:1789683328.218551:0:8675:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789683328.218588:0:8675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8675:1876618850104192:0@lo:5: 00000100:00100000:3.0:1789683328.218621:0:8675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683328.218647:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850104192 00000100:00100000:3.0:1789683328.218653:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850104192 00000100:00100000:3.0:1789683328.220853:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789683328.220875:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8675:x1876618850104192:12345-0@lo:5: 00002000:00080000:3.0:1789683328.220914:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789683328.220917:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789683328.221820:0:8671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f890e2000 going to sleep for 11 seconds 00010000:00080000:1.0:1789683328.221863:0:8671:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e82517480 x1876618850103808/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789683344 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683328.221878:0:8671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82517480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8671:1876618850103808:0@lo:7: 00000004:00080000:1.0:1789683328.221902:0:8671:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789683328.221940:0:8671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d42a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8671:1876618850104320:0@lo:5: 00000100:00100000:1.0:1789683328.221998:0:8671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683328.222027:0:8437:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789683328.222034:0:8437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789683328.222049:0:8671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f90575d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683328.223343:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850103936 00000100:00100000:1.0:1789683328.223356:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850103936 00000100:00100000:1.0:1789683328.223420:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683328.223430:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3647:x1876618850103936:12345-0@lo:13: 00002000:00000024:1.0:1789683328.223453:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789683328.223516:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3647:x1876618850103936:12345-0@lo:13: Request processed in 88us (13912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683328.223523:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789683328.223576:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e81d40380 x1876618850103936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683328.223595:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850103936:0@lo:13: 00000100:00080000:0.0:1789683328.228322:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683328.228343:0:8439:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789683328.228356:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850104320 00000100:00100000:0.0:1789683328.228366:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850104320 00000100:00100000:3.0:1789683328.228614:0:8675:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07750c0 going to sleep for 11 seconds 00000001:00080000:3.0:1789683328.233492:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789683328.233511:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789683328.233681:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8675:x1876618850104192:12345-0@lo:5: Request processed in 12805us (15046us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789683328.233692:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789683328.233722:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683328.233734:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8671:x1876618850104320:12345-0@lo:5: 00002000:00080000:1.0:1789683328.233768:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1789683328.233824:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8671:x1876618850104320:12345-0@lo:5: Request processed in 94us (11825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683328.233830:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789683328.233871:0:8671:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e81d42a00 x1876618850104320/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683344 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683328.233895:0:8671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d42a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8671:1876618850104320:0@lo:5: 00000004:00080000:1.0:1789683328.233908:0:8671:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789683328.233946:0:8671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d42a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8671:1876618850104448:0@lo:5: 00000100:00100000:1.0:1789683328.233976:0:8671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789683328.234048:0:8675:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb61f0380 x1876618850104192/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683344 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683328.234056:0:8675:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789683328.234060:0:8675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8675:1876618850104192:0@lo:5: 00000004:00080000:3.0:1789683328.234067:0:8675:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789683328.234088:0:8675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8675:1876618850104576:0@lo:700: 00000100:00100000:3.0:1789683328.234112:0:8675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683328.237169:0:8671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f90575d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683328.242809:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850104448 00000100:00100000:0.0:1789683328.242826:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850104448 00000100:00100000:0.0:1789683328.242902:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789683328.242913:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8671:x1876618850104448:12345-0@lo:5: 00002000:00080000:0.0:1789683328.242959:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1789683328.247869:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8671:x1876618850104448:12345-0@lo:5: Request processed in 4950us (13883us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789683328.247884:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683328.248162:0:8675:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07750c0 going to sleep for 11 seconds 00010000:00080000:1.0:1789683328.248276:0:8671:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e81d42a00 x1876618850104448/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683344 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683328.248295:0:8671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d42a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8671:1876618850104448:0@lo:5: 00000004:00080000:1.0:1789683328.248309:0:8671:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1789683328.248358:0:8671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d41180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8671:1876618850104704:0@lo:900: 00000100:00100000:1.0:1789683328.248410:0:8671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683328.248440:0:8671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f90575d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683328.248504:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850104704 00000100:00100000:3.0:1789683328.248522:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850104704 00000100:00100000:3.0:1789683328.248569:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683328.248577:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8671:x1876618850104704:12345-0@lo:900: 00000100:00100000:3.0:1789683328.248635:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8671:x1876618850104704:12345-0@lo:900: Request processed in 58us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683328.248641:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789683328.248770:0:8671:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e81d41180 x1876618850104704/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789683344 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683328.248780:0:8671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d41180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8671:1876618850104704:0@lo:900: 00000100:00100000:0.0:1789683328.248995:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850104576 00000100:00100000:0.0:1789683328.249000:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850104576 00000100:00100000:0.0:1789683328.249772:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683328.249804:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8675:x1876618850104576:12345-0@lo:700: 00000001:00080000:3.0:1789683328.265609:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:0.0:1789683328.266130:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8675:x1876618850104576:12345-0@lo:700: Request processed in 16345us (32012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.266143:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789683328.266250:0:8675:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb61f0380 x1876618850104576/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789683344 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683328.266264:0:8675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8675:1876618850104576:0@lo:700: 00000004:02000040:3.0:1789683328.267449:0:8675:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1789683328.274902:0:8675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89083b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8675:1876618850104832:0@lo:5: 00000100:00100000:2.0:1789683328.274980:0:8675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683328.276334:0:8675:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f857ee0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683328.277478:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850104832 00000100:00100000:1.0:1789683328.277491:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850104832 00000100:00100000:1.0:1789683328.277551:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789683328.277561:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8675:x1876618850104832:12345-0@lo:5: 00002000:00080000:2.0:1789683328.282242:0:8676:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789683328.282262:0:8676:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1789683328.283679:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8675:x1876618850104832:12345-0@lo:5: Request processed in 6114us (8694us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789683328.283694:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789683328.283938:0:8675:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0f89083b80 x1876618850104832/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683344 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683328.283956:0:8675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89083b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8675:1876618850104832:0@lo:5: 00000004:00080000:0.0:1789683328.283972:0:8675:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:0.0:1789683328.612375:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850104960:0@lo:41: 00000100:00100000:0.0:1789683328.612448:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683328.612534:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850104960 00000100:00100000:0.0:1789683328.612542:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850104960 00000100:00100000:0.0:1789683328.612591:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789683328.612600:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850104960:12345-0@lo:41: 00000004:00000024:0.0:1789683328.612631:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789683328.612674:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850104960:12345-0@lo:41: Request processed in 74us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.612680:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789683328.612723:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850104960:0@lo:41: 00010000:00010000:0.0:1789683329.059112:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683330.084084:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789683330.356525:0:8815:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789683331.107584:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789683331.518773:0:8867:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789683331.519924:0:8867:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789683332.129217:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789683332.462972:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1789683332.703108:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683332.703166:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850105088:0@lo:41: 00000100:00100000:3.0:1789683332.703233:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683332.706666:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850105088 00000100:00100000:1.0:1789683332.706684:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850105088 00000100:00100000:1.0:1789683332.706779:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789683332.706813:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850105088:12345-0@lo:41: 00000004:00000024:1.0:1789683332.706858:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789683332.706964:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850105088:12345-0@lo:41: Request processed in 155us (3730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683332.706972:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789683332.707867:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850105088:0@lo:41: 00010000:00010000:3.0:1789683333.151228:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683333.215717:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850105344:0@lo:400: 00000100:00100000:0.0:1789683333.215835:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683333.215897:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1876618850105856:0@lo:400: 00000100:00100000:0.0:1789683333.215919:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683333.215952:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789683333.215958:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850105472:0@lo:400: 00000100:00100000:0.0:1789683333.215984:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683333.216002:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850105984:0@lo:400: 00000100:00100000:0.0:1789683333.216035:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683333.216079:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850105344 00000100:00100000:0.0:1789683333.216087:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850105344 00000100:00100000:0.0:1789683333.216157:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850105856 00000100:00100000:0.0:1789683333.216161:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850105856 00000100:00100000:0.0:1789683333.216182:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850105984 00000100:00100000:0.0:1789683333.216185:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850105984 00000100:00100000:0.0:1789683333.216201:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789683333.216210:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850105344:12345-0@lo:400: 00000100:00100000:0.0:1789683333.216263:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850105344:12345-0@lo:400: Request processed in 54us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683333.216270:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789683333.216284:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789683333.216297:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876618850105856:12345-0@lo:400: 00000100:00100000:0.0:1789683333.216321:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876618850105856:12345-0@lo:400: Request processed in 32us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683333.216326:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789683333.216335:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789683333.216341:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850105984:12345-0@lo:400: 00000100:00100000:0.0:1789683333.216365:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850105984:12345-0@lo:400: Request processed in 25us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683333.216371:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789683333.216388:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850105472 00000100:00100000:0.0:1789683333.216392:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850105472 00000100:00100000:0.0:1789683333.216427:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789683333.216434:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850105472:12345-0@lo:400: 00000100:00100000:0.0:1789683333.216464:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850105472:12345-0@lo:400: Request processed in 31us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683333.216476:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789683333.217649:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850105600:0@lo:400: 00000100:00100000:2.0:1789683333.217710:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683333.217762:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850106112:0@lo:400: 00000100:00100000:2.0:1789683333.217824:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683333.217859:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789683333.217867:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850105216:0@lo:400: 00000100:00100000:2.0:1789683333.217897:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683333.217918:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850105728:0@lo:400: 00000100:00100000:2.0:1789683333.217939:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683333.217955:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850106240:0@lo:400: 00000100:00100000:2.0:1789683333.217971:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683333.217998:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850106112 00000100:00100000:2.0:1789683333.218004:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850106112 00000100:00100000:2.0:1789683333.218038:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850106240 00000100:00100000:2.0:1789683333.218051:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850106240 00000100:00100000:2.0:1789683333.218086:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683333.218093:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850106112:12345-0@lo:400: 00000100:00100000:2.0:1789683333.218149:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850106112:12345-0@lo:400: Request processed in 56us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683333.218155:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683333.218169:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789683333.218175:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850106240:12345-0@lo:400: 00000100:00100000:2.0:1789683333.218198:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850106240:12345-0@lo:400: Request processed in 25us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683333.218203:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789683333.218224:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850105728 00000100:00100000:2.0:1789683333.218227:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850105728 00000100:00100000:1.0:1789683333.218323:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683333.218331:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850106368:0@lo:13: 00000100:00100000:1.0:1789683333.218358:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683333.218387:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850106368 00000100:00100000:1.0:1789683333.218390:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850106368 00000100:00100000:1.0:1789683333.218415:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789683333.218421:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850106368:12345-0@lo:13: 00002000:00000024:1.0:1789683333.218443:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683333.218478:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850106368:12345-0@lo:13: Request processed in 56us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683333.218495:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789683333.218532:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e81d41180 x1876618850106368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683333.218542:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789683333.218561:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850106368:0@lo:13: 00000100:00080000:1.0:1789683333.218596:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683333.218601:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789683333.218603:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683333.218623:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850105472:0@lo:400: 00010000:00080000:1.0:1789683333.218651:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0f88cdd880 x1876618850105984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683333.218660:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850105984:0@lo:400: 00010000:00080000:1.0:1789683333.218671:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb61f3100 x1876618850105344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683333.218679:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850105344:0@lo:400: 00010000:00080000:1.0:1789683333.218691:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0f88cded80 x1876618850105856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683333.218699:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1876618850105856:0@lo:400: 00000100:00100000:1.0:1789683333.218743:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850105216 00000100:00100000:1.0:1789683333.218747:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850105216 00000100:00100000:1.0:1789683333.218771:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789683333.218778:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:3649:x1876618850105216:12345-0@lo:400: 00000100:00100000:1.0:1789683333.218832:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:3649:x1876618850105216:12345-0@lo:400: Request processed in 54us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683333.218837:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789683333.218873:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850105600 00000100:00100000:1.0:1789683333.218876:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850105600 00000100:00100000:1.0:1789683333.218892:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789683333.218897:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850105600:12345-0@lo:400: 00000100:00100000:1.0:1789683333.218924:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850105600:12345-0@lo:400: Request processed in 26us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683333.218929:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789683333.219705:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850105216:0@lo:400: 00010000:00080000:3.0:1789683333.219722:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb7960380 x1876618850106240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683333.219732:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1789683333.219753:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850106240:0@lo:400: 00010000:00080000:3.0:1789683333.219767:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0f88cdd180 x1876618850105600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683333.219775:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850105600:0@lo:400: 00010000:00080000:3.0:1789683333.219817:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0f88cddf80 x1876618850106112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683333.219825:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850106112:0@lo:400: 00000100:00100000:2.0:1789683333.221776:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789683333.221817:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850105728:12345-0@lo:400: 00000100:00100000:2.0:1789683333.221977:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850105728:12345-0@lo:400: Request processed in 171us (4036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683333.221985:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789683333.222952:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850105728:0@lo:400: 00000100:00100000:1.0:1789683333.732812:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850106496:0@lo:13: 00000100:00100000:1.0:1789683333.732906:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683333.732988:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850106496 00000100:00100000:1.0:1789683333.732997:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850106496 00000100:00100000:1.0:1789683333.733049:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683333.733058:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850106496:12345-0@lo:13: 00002000:00000024:1.0:1789683333.733084:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683333.733136:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850106496:12345-0@lo:13: Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683333.733143:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789683333.733200:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e81d41180 x1876618850106496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683333.733218:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850106496:0@lo:13: 00000100:00100000:1.0:1789683333.736747:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850106624:0@lo:41: 00000100:00100000:1.0:1789683333.736841:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683333.736899:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850106624 00000100:00100000:1.0:1789683333.736906:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850106624 00000100:00100000:1.0:1789683333.736956:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789683333.736966:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850106624:12345-0@lo:41: 00000004:00000024:1.0:1789683333.737005:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789683333.737050:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850106624:12345-0@lo:41: Request processed in 85us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683333.737057:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789683333.737124:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850106624:0@lo:41: 00010000:00010000:0.0:1789683334.175084:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789683334.460639:0:8969:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789683334.461120:0:8969:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789683335.204918:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789683335.247270:0:9017:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789683335.247280:0:9017:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1789683336.228626:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683337.247252:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683337.825623:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683337.825649:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850106752:0@lo:41: 00000100:00100000:3.0:1789683337.825725:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683337.826267:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850106752 00000100:00100000:0.0:1789683337.826277:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850106752 00000100:00100000:0.0:1789683337.826338:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789683337.826348:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850106752:12345-0@lo:41: 00000004:00000024:0.0:1789683337.826383:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789683337.826446:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850106752:12345-0@lo:41: Request processed in 99us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683337.826454:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789683337.826584:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850106752:0@lo:41: 00010000:00010000:1.0:1789683338.272172:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683338.334984:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683338.335007:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850106880:0@lo:13: 00000100:00100000:1.0:1789683338.335081:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683338.335142:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850106880 00000100:00100000:1.0:1789683338.335149:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850106880 00000100:00100000:1.0:1789683338.335199:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789683338.335209:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850106880:12345-0@lo:13: 00002000:00000024:1.0:1789683338.335239:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683338.335282:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850106880:12345-0@lo:13: Request processed in 75us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683338.335290:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789683338.335312:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789683338.335340:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e81d41180 x1876618850106880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683338.335358:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850106880:0@lo:13: 00000100:00100000:0.0:1789683338.341024:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850107008:0@lo:400: 00000100:00100000:0.0:1789683338.341110:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683338.341154:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850107520:0@lo:400: 00000100:00100000:0.0:1789683338.341180:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683338.341209:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789683338.341215:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850107392:0@lo:400: 00000100:00100000:0.0:1789683338.341239:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683338.341257:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850107904:0@lo:400: 00000100:00100000:0.0:1789683338.341276:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683338.341301:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850107136:0@lo:400: 00000100:00100000:0.0:1789683338.341335:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683338.341358:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850107648:0@lo:400: 00000100:00100000:0.0:1789683338.341379:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683338.341397:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789683338.341403:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850107264:0@lo:400: 00000100:00100000:0.0:1789683338.341433:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683338.341450:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850107776:0@lo:400: 00000100:00100000:0.0:1789683338.341470:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683338.341514:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850107008 00000100:00100000:0.0:1789683338.341521:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850107008 00000100:00100000:0.0:1789683338.341560:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789683338.341568:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:3648:x1876618850107008:12345-0@lo:400: 00000100:00100000:0.0:1789683338.341616:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:3648:x1876618850107008:12345-0@lo:400: Request processed in 47us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683338.341623:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789683338.341669:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850107520 00000100:00100000:0.0:1789683338.341674:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850107520 00000100:00100000:0.0:1789683338.341695:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850107264 00000100:00100000:0.0:1789683338.341697:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850107264 00000100:00100000:0.0:1789683338.341710:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789683338.341716:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850107520:12345-0@lo:400: 00000100:00100000:0.0:1789683338.341749:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850107520:12345-0@lo:400: Request processed in 34us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683338.341755:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789683338.341765:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789683338.341770:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850107264:12345-0@lo:400: 00000100:00100000:0.0:1789683338.341827:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850107264:12345-0@lo:400: Request processed in 56us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683338.341833:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789683338.341849:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850107392 00000100:00100000:0.0:1789683338.341853:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850107392 00000100:00100000:0.0:1789683338.341868:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850107136 00000100:00100000:0.0:1789683338.341875:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850107136 00000100:00100000:0.0:1789683338.341887:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850107648 00000100:00100000:0.0:1789683338.341888:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850107648 00000100:00100000:0.0:1789683338.341909:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850107776 00000100:00100000:0.0:1789683338.341912:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850107776 00000100:00100000:0.0:1789683338.341925:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789683338.341931:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850107392:12345-0@lo:400: 00000100:00100000:0.0:1789683338.341960:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850107392:12345-0@lo:400: Request processed in 30us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683338.341965:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789683338.341977:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789683338.341981:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850107136:12345-0@lo:400: 00000100:00100000:0.0:1789683338.342004:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850107136:12345-0@lo:400: Request processed in 23us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683338.342009:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789683338.342019:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789683338.342024:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850107648:12345-0@lo:400: 00000100:00100000:0.0:1789683338.342060:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850107648:12345-0@lo:400: Request processed in 35us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683338.342065:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789683338.342075:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789683338.342081:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850107776:12345-0@lo:400: 00000100:00100000:0.0:1789683338.342105:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850107776:12345-0@lo:400: Request processed in 25us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683338.342111:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789683338.342128:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850107904 00000100:00100000:0.0:1789683338.342132:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850107904 00000100:00100000:0.0:1789683338.342166:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683338.342172:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850107904:12345-0@lo:400: 00000100:00100000:0.0:1789683338.342203:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850107904:12345-0@lo:400: Request processed in 31us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683338.342208:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789683338.342242:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683338.342248:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683338.342250:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683338.342284:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850107264:0@lo:400: 00010000:00080000:0.0:1789683338.342298:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e82515180 x1876618850107776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683338.342309:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850107776:0@lo:400: 00010000:00080000:0.0:1789683338.342320:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e82514000 x1876618850107136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683338.342328:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850107136:0@lo:400: 00010000:00080000:0.0:1789683338.342336:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e82516a00 x1876618850107648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683338.342344:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850107648:0@lo:400: 00010000:00080000:0.0:1789683338.342376:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e82516300 x1876618850107392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683338.342384:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850107392:0@lo:400: 00010000:00080000:0.0:1789683338.342393:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0f88c76300 x1876618850107904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683338.342401:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850107904:0@lo:400: 00000100:00100000:0.0:1789683338.342420:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850107008:0@lo:400: 00000100:00100000:0.0:1789683338.342429:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850107520:0@lo:400: 00000100:00100000:3.0:1789683338.848124:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850108032:0@lo:13: 00000100:00100000:3.0:1789683338.848197:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683338.848331:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850108032 00000100:00100000:2.0:1789683338.848340:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850108032 00000100:00100000:2.0:1789683338.848400:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789683338.848410:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850108032:12345-0@lo:13: 00002000:00000024:2.0:1789683338.848432:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683338.848478:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850108032:12345-0@lo:13: Request processed in 70us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683338.848484:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789683338.848570:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0f89080e00 x1876618850108032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683338.848601:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850108032:0@lo:13: 00000100:00100000:2.0:1789683338.852559:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850108160:0@lo:41: 00000100:00100000:2.0:1789683338.852654:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683338.852991:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850108160 00000100:00100000:0.0:1789683338.853004:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850108160 00000100:00100000:0.0:1789683338.853070:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789683338.853080:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850108160:12345-0@lo:41: 00000004:00000024:0.0:1789683338.853128:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789683338.853320:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850108160:12345-0@lo:41: Request processed in 241us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683338.853328:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789683338.853421:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850108160:0@lo:41: 00010000:00010000:0.0:1789683339.298478:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683340.321171:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683341.351431:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683342.370548:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683342.943093:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683342.943120:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850108288:0@lo:41: 00000100:00100000:0.0:1789683342.943197:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683342.943297:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850108288 00000100:00100000:2.0:1789683342.943306:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850108288 00000100:00100000:2.0:1789683342.943358:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789683342.943367:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850108288:12345-0@lo:41: 00000004:00000024:2.0:1789683342.943401:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789683342.943587:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850108288:12345-0@lo:41: Request processed in 100us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683342.943597:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789683342.943827:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850108288:0@lo:41: 00010000:00010000:2.0:1789683343.391155:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683343.459924:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683343.459964:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850108416:0@lo:13: 00000100:00100000:3.0:1789683343.460044:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683343.466093:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850108416 00000100:00100000:2.0:1789683343.466108:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850108416 00000100:00100000:2.0:1789683343.466175:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789683343.466190:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850108416:12345-0@lo:13: 00002000:00000024:2.0:1789683343.466232:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683343.466324:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850108416:12345-0@lo:13: Request processed in 139us (6279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683343.466330:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789683343.466361:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850108928:0@lo:400: 00000100:00100000:2.0:1789683343.466402:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683343.466428:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850109440:0@lo:400: 00000100:00100000:2.0:1789683343.466451:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683343.466482:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789683343.466488:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850108544:0@lo:400: 00000100:00100000:2.0:1789683343.466513:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683343.466538:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850109056:0@lo:400: 00000100:00100000:2.0:1789683343.466572:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683343.466597:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850108672:0@lo:400: 00010000:00080000:0.0:1789683343.466805:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb7961f80 x1876618850108416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683343.466826:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850108416:0@lo:13: 00000100:00100000:2.0:1789683343.467462:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683343.467498:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850109184:0@lo:400: 00000100:00100000:2.0:1789683343.467533:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683343.467557:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789683343.467562:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850108800:0@lo:400: 00000100:00100000:2.0:1789683343.467583:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683343.467598:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850109312:0@lo:400: 00000100:00100000:2.0:1789683343.468601:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683343.468825:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850108928 00000100:00100000:3.0:1789683343.468834:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850108928 00000100:00100000:3.0:1789683343.468884:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850108672 00000100:00100000:3.0:1789683343.468888:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850108672 00000100:00100000:3.0:1789683343.468899:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850109184 00000100:00100000:3.0:1789683343.468902:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850109184 00000100:00100000:3.0:1789683343.468915:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850109312 00000100:00100000:3.0:1789683343.468917:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850109312 00000100:00100000:3.0:1789683343.468931:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789683343.468949:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850108928:12345-0@lo:400: 00000100:00100000:3.0:1789683343.469015:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850108928:12345-0@lo:400: Request processed in 76us (2611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683343.469022:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789683343.469036:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789683343.469041:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850108672:12345-0@lo:400: 00000100:00100000:3.0:1789683343.469074:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850108672:12345-0@lo:400: Request processed in 33us (2456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683343.469080:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789683343.469091:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789683343.469096:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850109184:12345-0@lo:400: 00000100:00100000:3.0:1789683343.469124:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850109184:12345-0@lo:400: Request processed in 28us (1591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683343.469129:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789683343.469141:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789683343.469146:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850109312:12345-0@lo:400: 00000100:00100000:3.0:1789683343.469172:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850109312:12345-0@lo:400: Request processed in 27us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683343.469178:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1789683343.469231:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789683343.469236:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683343.469238:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683343.469261:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850109440 00000100:00100000:2.0:1789683343.469266:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850109440 00000100:00100000:2.0:1789683343.469309:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683343.469316:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850109440:12345-0@lo:400: 00000100:00100000:2.0:1789683343.469347:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850109440:12345-0@lo:400: Request processed in 32us (2895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683343.469352:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683343.469372:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850109056 00000100:00100000:2.0:1789683343.469377:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850109056 00000100:00100000:2.0:1789683343.469398:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850108800 00000100:00100000:2.0:1789683343.469401:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850108800 00000100:00100000:2.0:1789683343.469414:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789683343.469419:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850109056:12345-0@lo:400: 00000100:00100000:2.0:1789683343.469451:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850109056:12345-0@lo:400: Request processed in 31us (2878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683343.469465:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789683343.469478:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789683343.469484:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850108800:12345-0@lo:400: 00000100:00100000:2.0:1789683343.469513:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850108800:12345-0@lo:400: Request processed in 30us (1929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683343.469518:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789683343.469562:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850109056:0@lo:400: 00010000:00080000:2.0:1789683343.469577:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc0bd9f80 x1876618850108928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683343.469586:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850108928:0@lo:400: 00010000:00080000:2.0:1789683343.469596:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc0bdb100 x1876618850109440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683343.469603:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850109440:0@lo:400: 00000100:00100000:2.0:1789683343.470327:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850108800:0@lo:400: 00010000:00080000:2.0:1789683343.470342:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc0bdb480 x1876618850109312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683343.470351:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850109312:0@lo:400: 00010000:00080000:2.0:1789683343.470361:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0f89082a00 x1876618850108672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683343.470369:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850108672:0@lo:400: 00010000:00080000:2.0:1789683343.470379:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc0bd8000 x1876618850109184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683343.470402:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850109184:0@lo:400: 00000100:00080000:3.0:1789683343.470485:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683343.470850:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850108544 00000100:00100000:0.0:1789683343.470856:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850108544 00000100:00100000:0.0:1789683343.470895:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789683343.470902:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:3647:x1876618850108544:12345-0@lo:400: 00000100:00100000:0.0:1789683343.470971:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:3647:x1876618850108544:12345-0@lo:400: Request processed in 69us (4456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683343.470977:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789683343.471142:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850108544:0@lo:400: 00000100:00100000:0.0:1789683343.970382:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683343.970432:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850109568:0@lo:41: 00000100:00100000:0.0:1789683343.970542:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683343.970643:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850109568 00000100:00100000:0.0:1789683343.970654:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850109568 00000100:00100000:0.0:1789683343.970734:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789683343.970747:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850109568:12345-0@lo:41: 00000004:00000024:0.0:1789683343.970826:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789683343.970899:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850109568:12345-0@lo:41: Request processed in 156us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683343.970906:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789683343.971082:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850109568:0@lo:41: 00000100:00100000:1.0:1789683343.971989:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683343.972020:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850109696:0@lo:13: 00000100:00100000:1.0:1789683343.972100:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683343.972208:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850109696 00000100:00100000:3.0:1789683343.972217:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850109696 00000100:00100000:3.0:1789683343.972271:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789683343.972280:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850109696:12345-0@lo:13: 00002000:00000024:3.0:1789683343.972303:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683343.972368:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850109696:12345-0@lo:13: Request processed in 89us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683343.972376:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789683343.972638:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb7960000 x1876618850109696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683343.972657:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850109696:0@lo:13: 00010000:00010000:1.0:1789683344.420411:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789683344.919593:0:9516:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789683344.919597:0:9516:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789683344.919598:0:9516:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789683344.919739:0:9516:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0e827aa000 00000020:01000004:1.0:1789683344.919762:0:9516:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789683344.919780:0:9516:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789683344.919829:0:9516:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9f0f861819c0) 00000020:00000080:1.0:1789683344.919845:0:9516:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789683344.962565:0:9516:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789683344.962622:0:9516:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1789683345.002482:0:9516:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789683345.002702:0:9516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789683345.002717:0:9516:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789683345.002731:0:9516:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf8485587b8894ae 00000020:01000004:2.0:1789683345.002739:0:9516:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789683345.002761:0:9516:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.150@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789683345.002765:0:9516:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789683345.002770:0:9516:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789683345.003362:0:9516:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789683345.003368:0:9516:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789683345.033966:0:9516:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789683345.034011:0:9516:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.150@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789683345.034016:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789683345.034018:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789683345.034019:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683345.034020:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683345.034021:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683345.034023:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683345.034024:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683345.034026:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789683345.034027:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789683345.034029:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683345.034030:0:9516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789683345.034034:0:9516:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789683345.034037:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789683345.034039:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789683345.034040:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683345.034041:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683345.034042:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683345.034043:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683345.034044:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683345.034045:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789683345.034050:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789683345.034051:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683345.034052:0:9516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789683345.034078:0:9516:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789683345.034100:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850109824:0@lo:253: 00000100:00100000:2.0:1789683345.034179:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683345.035155:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850109824 00000100:00100000:3.0:1789683345.035167:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850109824 00000100:00100000:2.0:1789683345.037573:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb7922780 going to sleep for 11 seconds 00000100:00100000:3.0:1789683345.037624:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789683345.037642:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:9516:x1876618850109824:12345-0@lo:253: 20000000:01000000:3.0:1789683345.037697:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789683345.037703:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789683345.037708:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789683345.037711:0:6516:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789683345.038114:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683345.038663:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1789683345.038682:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789683345.038700:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1789683345.038705:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789683345.038715:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1789683345.038727:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1789683345.038940:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1789683345.038957:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.150@tcp 20000000:01000000:3.0:1789683345.038959:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:3.0:1789683345.038971:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1789683345.038976:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789683345.038988:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1789683345.038999:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:3.0:1789683345.039011:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1789683345.039017:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789683345.039027:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1789683345.039040:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1789683345.039103:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1789683345.039112:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.150@tcp 20000000:01000000:3.0:1789683345.039114:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:3.0:1789683345.039125:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1789683345.039129:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789683345.039139:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1789683345.039143:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:3.0:1789683345.039152:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1789683345.039156:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789683345.039165:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1789683345.039176:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1789683345.039739:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1789683345.039752:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.150@tcp 20000000:01000000:3.0:1789683345.039754:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:3.0:1789683345.039768:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1789683345.039773:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789683345.039976:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1789683345.039984:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:3.0:1789683345.040001:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1789683345.040007:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789683345.040021:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1789683345.040036:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1789683345.040049:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789683345.040052:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789683345.040055:0:6516:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789683345.040100:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789683345.040111:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789683345.040726:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1789683345.040760:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1789683345.040773:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789683345.041572:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789683345.041596:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1789683345.041610:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1789683345.041620:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789683345.041622:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789683345.042150:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1789683345.042172:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1789683345.042184:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1789683345.042393:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1789683345.042411:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1789683345.042422:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1789683345.042430:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789683345.042432:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789683345.042778:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1789683345.042983:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1789683345.043001:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1789683345.043012:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1789683345.043021:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789683345.043023:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789683345.043477:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1789683345.043496:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1789683345.043512:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1789683345.043641:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1789683345.043659:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1789683345.043672:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1789683345.043680:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789683345.043681:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789683345.043993:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1789683345.044012:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1789683345.044026:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1789683345.044142:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1789683345.044161:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1789683345.044177:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:1.0:1789683345.044193:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789683345.044354:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0f81676200/0xcf8485587b8894b5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.044446:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b8893ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8893a4 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.044457:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8893d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8893ce expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.044472:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b889414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88940d expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.044479:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fa01f9400/0xcf8485587b889430 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889429 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.044486:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f80031200/0xcf8485587b88945a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889453 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.044493:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f80031c00/0xcf8485587b889476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88946f expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.044500:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f81390c00/0xcf8485587b8894a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889499 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.044507:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0f81676200/0xcf8485587b8894b5 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.044546:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f81390c00/0xcf8485587b8894a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b889499 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.044561:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f81390c00/0xcf8485587b8894a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b889499 expref: 21 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683345.044576:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d40000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1876618850109952:0@lo:104: 00000100:00100000:1.0:1789683345.044648:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683345.044742:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f80031c00/0xcf8485587b889476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88946f expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.044750:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f80031c00/0xcf8485587b889476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88946f expref: 21 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683345.044764:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1876618850110080:0@lo:104: 00000100:00100000:1.0:1789683345.044815:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683345.045154:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f80031200/0xcf8485587b88945a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b889453 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.045163:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f80031200/0xcf8485587b88945a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b889453 expref: 21 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683345.045172:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1876618850110208:0@lo:104: 00000100:00100000:1.0:1789683345.045191:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683345.045283:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fa01f9400/0xcf8485587b889430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b889429 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.045291:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0fa01f9400/0xcf8485587b889430 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b889429 expref: 21 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683345.045299:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1876618850110336:0@lo:104: 00000100:00100000:1.0:1789683345.045317:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683345.045329:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b889414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88940d expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.045337:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b889414 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88940d expref: 21 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683345.045344:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1876618850110464:0@lo:104: 00000100:00100000:1.0:1789683345.045358:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683345.045369:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8893d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b8893ce expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.045456:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8893d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b8893ce expref: 21 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683345.045465:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1876618850110592:0@lo:104: 00000100:00100000:1.0:1789683345.045488:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683345.045503:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b8893ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b8893a4 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.045510:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b8893ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b8893a4 expref: 21 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683345.045518:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1876618850110720:0@lo:104: 00000100:00100000:1.0:1789683345.045532:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f853943c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683345.045648:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789683345.045667:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683345.045676:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850109952 00000100:00100000:3.0:1789683345.045682:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850109952 00000100:00100000:3.0:1789683345.045715:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850110080 00000100:00100000:3.0:1789683345.045717:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850110080 00000100:00100000:3.0:1789683345.045725:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850110208 00000100:00100000:3.0:1789683345.045726:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850110208 00000100:00100000:3.0:1789683345.045734:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850110336 00000100:00100000:3.0:1789683345.045735:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850110336 00000100:00100000:3.0:1789683345.045742:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850110464 00000100:00100000:3.0:1789683345.045744:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850110464 00000100:00100000:3.0:1789683345.045750:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850110592 00000100:00100000:3.0:1789683345.045752:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850110592 00000100:00100000:3.0:1789683345.045758:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850110720 00000100:00100000:3.0:1789683345.045765:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850110720 00000100:00100000:3.0:1789683345.045777:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789683345.046160:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+9:6516:x1876618850109952:12345-0@lo:104: 00010000:00010000:3.0:1789683345.046173:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b889499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8894a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.046332:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789683345.046338:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+9:6516:x1876618850109952:12345-0@lo:104: Request processed in 183us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683345.046345:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789683345.046364:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789683345.046370:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+8:6516:x1876618850110080:12345-0@lo:104: 00010000:00010000:3.0:1789683345.046385:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f80031400/0xcf8485587b88946f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889476 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683345.046615:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d40000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1876618850109952:0@lo:104: 00000100:00100000:1.0:1789683345.046623:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1876618850110080:0@lo:104: 00010000:00010000:0.0:1789683345.046651:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683345.046658:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b889499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8894a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.046665:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f80031a00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683345.046669:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b889499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8894a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.046677:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b889499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8894a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683345.046685:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b889499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8894a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683345.046690:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789683345.046747:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b889499 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8894a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.046754:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683345.046799:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b889499 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8894a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.046806:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b889499 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8894a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.046819:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683345.046822:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f80031400/0xcf8485587b88946f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889476 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.046828:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f80031400 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683345.046831:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80031400/0xcf8485587b88946f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b889476 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.046838:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f80031400/0xcf8485587b88946f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b889476 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683345.046844:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80031400/0xcf8485587b88946f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b889476 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683345.046849:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789683345.046887:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850110848:0@lo:103: 00000100:00100000:2.0:1789683345.046928:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683345.046968:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850110848 00000100:00100000:2.0:1789683345.046972:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850110848 00010000:00010000:2.0:1789683345.046990:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f81390c00/0xcf8485587b8894a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889499 expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683345.047009:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789683345.047015:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:3650:x1876618850110848:12345-0@lo:103: 00010000:00010000:2.0:1789683345.047024:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683345.047028:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f81390c00/0xcf8485587b8894a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889499 expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.047038:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f81390c00/0xcf8485587b8894a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b889499 expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.047050:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81390c00/0xcf8485587b8894a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b889499 expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.047062:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683345.047085:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:3650:x1876618850110848:12345-0@lo:103: Request processed in 71us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683345.047091:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789683345.047122:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850110848:0@lo:103: 00010000:00010000:3.0:1789683345.047179:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789683345.047186:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+8:6516:x1876618850110080:12345-0@lo:104: Request processed in 816us (2370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683345.047192:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789683345.047218:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789683345.047224:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+7:6516:x1876618850110208:12345-0@lo:104: 00010000:00010000:3.0:1789683345.047232:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88945a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.047274:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789683345.047279:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+7:6516:x1876618850110208:12345-0@lo:104: Request processed in 56us (2087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683345.047285:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789683345.047301:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683345.047306:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+6:6516:x1876618850110336:12345-0@lo:104: 00010000:00010000:3.0:1789683345.047313:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889430 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.047336:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789683345.047340:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+6:6516:x1876618850110336:12345-0@lo:104: Request processed in 35us (2022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683345.047345:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683345.047353:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789683345.047358:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:6516:x1876618850110464:12345-0@lo:104: 00010000:00010000:3.0:1789683345.047364:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b88940d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889414 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.047546:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789683345.047552:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:6516:x1876618850110464:12345-0@lo:104: Request processed in 194us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683345.047558:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789683345.047569:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789683345.047574:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81f99c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:6516:x1876618850110592:12345-0@lo:104: 00010000:00010000:3.0:1789683345.047581:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8893ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8893d5 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.047603:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789683345.047607:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81f99c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:6516:x1876618850110592:12345-0@lo:104: Request processed in 33us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683345.047612:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789683345.047640:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789683345.047646:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:6516:x1876618850110720:12345-0@lo:104: 00010000:00010000:3.0:1789683345.047652:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8893a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8893ab expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.047674:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789683345.047678:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:6516:x1876618850110720:12345-0@lo:104: Request processed in 33us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683345.047683:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789683345.047706:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1876618850110208:0@lo:104: 00000100:00100000:3.0:1789683345.047713:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1876618850110336:0@lo:104: 00000100:00100000:3.0:1789683345.047718:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1876618850110464:0@lo:104: 00000100:00100000:3.0:1789683345.047725:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1876618850110592:0@lo:104: 00000100:00100000:3.0:1789683345.047731:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1876618850110720:0@lo:104: 00010000:00010000:3.0:1789683345.047754:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0f81676200/0xcf8485587b8894b5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.047816:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789683345.048186:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789683345.048342:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88945a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048351:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9200 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683345.048355:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88945a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048363:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88945a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683345.048371:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88945a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683345.048453:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683345.048490:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889453 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88945a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048496:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683345.048515:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889453 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88945a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048521:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b889453 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88945a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048532:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789683345.048536:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b88940d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889414 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048541:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677600 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683345.048544:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b88940d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b889414 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048550:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b88940d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b889414 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683345.048555:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b88940d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b889414 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683345.048560:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683345.048572:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b88940d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889414 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048578:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683345.048589:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b88940d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889414 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048595:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f81677600/0xcf8485587b88940d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889414 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048605:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683345.048607:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8893ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8893d5 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048613:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8000 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683345.048616:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8893ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8893d5 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048622:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8893ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8893d5 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683345.048628:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8893ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8893d5 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683345.048633:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683345.048645:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8893ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8893d5 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048650:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683345.048661:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8893ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8893d5 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048667:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8893ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8893d5 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048674:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683345.048683:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8893a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8893ab expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048689:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8200 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683345.048692:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8893a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8893ab expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048698:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8893a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8893ab expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683345.048703:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8893a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8893ab expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683345.048708:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683345.048721:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8893a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8893ab expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048726:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683345.048731:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8893a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8893ab expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048737:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b8893a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8893ab expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.048745:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683345.048747:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683345.048749:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683345.048763:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850111104:0@lo:103: 00000100:00100000:3.0:1789683345.048836:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683345.048872:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683345.048878:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850110976:0@lo:103: 00000100:00100000:3.0:1789683345.048907:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683345.048945:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850111360:0@lo:103: 00000100:00100000:3.0:1789683345.048969:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683345.048986:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683345.048992:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850111232:0@lo:103: 00000100:00100000:3.0:1789683345.049010:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683345.049029:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850111104 00000100:00100000:3.0:1789683345.049036:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850111104 00010000:00010000:3.0:1789683345.049075:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b889414 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88940d expref: 21 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683345.049094:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850110976 00000100:00100000:3.0:1789683345.049099:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850110976 00010000:00010000:3.0:1789683345.049111:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f80031200/0xcf8485587b88945a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889453 expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683345.049122:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850111360 00000100:00100000:3.0:1789683345.049124:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850111360 00010000:00010000:3.0:1789683345.049132:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b8893ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8893a4 expref: 23 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683345.049141:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850111232 00000100:00100000:3.0:1789683345.049143:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850111232 00010000:00010000:3.0:1789683345.049152:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8893d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8893ce expref: 24 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683345.049164:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789683345.049170:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850111104:12345-0@lo:103: 00010000:00010000:3.0:1789683345.049180:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683345.049185:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b889414 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88940d expref: 24 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.049619:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b889414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88940d expref: 24 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.049634:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f9c00/0xcf8485587b889414 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88940d expref: 24 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.049645:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683345.049692:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:3648:x1876618850111104:12345-0@lo:103: Request processed in 522us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683345.049699:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789683345.049717:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789683345.049723:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:3648:x1876618850110976:12345-0@lo:103: 00010000:00010000:3.0:1789683345.049731:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683345.049735:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f80031200/0xcf8485587b88945a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889453 expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.049743:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f80031200/0xcf8485587b88945a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b889453 expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.049752:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f80031200/0xcf8485587b88945a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b889453 expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.049760:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683345.049779:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:3648:x1876618850110976:12345-0@lo:103: Request processed in 57us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683345.049813:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789683345.049824:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683345.049829:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb29fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:3650:x1876618850111360:12345-0@lo:103: 00010000:00010000:3.0:1789683345.049843:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683345.049848:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b8893ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8893a4 expref: 20 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.049856:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b8893ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b8893a4 expref: 20 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.049865:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b8893ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b8893a4 expref: 20 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.049872:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683345.049896:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb29fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+19:3650:x1876618850111360:12345-0@lo:103: Request processed in 67us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683345.049901:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683345.049948:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789683345.049953:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:3650:x1876618850111232:12345-0@lo:103: 00010000:00010000:3.0:1789683345.049959:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683345.049964:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8893d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8893ce expref: 18 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.049971:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8893d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b8893ce expref: 18 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.049980:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8893d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b8893ce expref: 18 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.049988:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683345.050006:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:3650:x1876618850111232:12345-0@lo:103: Request processed in 54us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683345.050012:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789683345.050052:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850111232:0@lo:103: 00000100:00100000:3.0:1789683345.050060:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850111360:0@lo:103: 00000100:00100000:1.0:1789683345.050323:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850110976:0@lo:103: 00000100:00100000:1.0:1789683345.050334:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850111104:0@lo:103: 00010000:00010000:3.0:1789683345.050512:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683345.050515:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683345.050516:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683345.050594:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f80031400/0xcf8485587b88946f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889476 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.050602:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683345.050620:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f80031400/0xcf8485587b88946f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889476 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.050626:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f80031400/0xcf8485587b88946f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889476 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.050639:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683345.050647:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683345.050649:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683345.050667:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850111488:0@lo:103: 00000100:00100000:0.0:1789683345.050699:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.050738:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850111488 00000100:00100000:0.0:1789683345.050743:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850111488 00010000:00010000:0.0:1789683345.050762:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f80031c00/0xcf8485587b889476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88946f expref: 17 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683345.050779:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789683345.050812:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:3647:x1876618850111488:12345-0@lo:103: 00010000:00010000:0.0:1789683345.050821:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683345.050824:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f80031c00/0xcf8485587b889476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88946f expref: 17 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.050834:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f80031c00/0xcf8485587b889476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88946f expref: 17 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.050843:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f80031c00/0xcf8485587b889476 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88946f expref: 17 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.050852:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683345.050876:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:3647:x1876618850111488:12345-0@lo:103: Request processed in 66us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683345.050881:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789683345.050931:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850111488:0@lo:103: 00010000:00010000:2.0:1789683345.051349:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889430 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.051358:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8c00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683345.051362:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b889430 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.051370:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b889430 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683345.051451:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b889430 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683345.051457:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789683345.051530:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889429 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889430 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.051537:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683345.051553:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889429 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889430 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.051560:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889429 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889430 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.051575:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683345.051577:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683345.051579:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683345.051614:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683345.051626:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850111616:0@lo:103: 00000100:00100000:0.0:1789683345.051657:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683345.051742:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850111616 00000100:00100000:2.0:1789683345.051752:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850111616 00010000:00010000:2.0:1789683345.051773:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fa01f9400/0xcf8485587b889430 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889429 expref: 16 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683345.051826:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789683345.051833:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:3647:x1876618850111616:12345-0@lo:103: 00010000:00010000:2.0:1789683345.051841:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683345.051846:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fa01f9400/0xcf8485587b889430 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889429 expref: 16 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.051855:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fa01f9400/0xcf8485587b889430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b889429 expref: 16 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.051865:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f9400/0xcf8485587b889430 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b889429 expref: 16 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.051876:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0f81676200/0xcf8485587b8894b5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.051885:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81676200/0xcf8485587b8894b5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.051899:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0f81676200/0xcf8485587b8894b5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.051907:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0f81676200/0xcf8485587b8894b5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.051925:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0f81676200/0xcf8485587b8894b5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.051931:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0f81676200/0xcf8485587b8894b5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.051943:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81676200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683345.051947:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0f81676200/0xcf8485587b8894b5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.051954:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0f81676200/0xcf8485587b8894b5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.051971:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0f81676200/0xcf8485587b8894b5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.051981:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683345.052012:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:3647:x1876618850111616:12345-0@lo:103: Request processed in 181us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683345.052018:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789683345.052099:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850111616:0@lo:103: 00010000:00010000:3.0:1789683345.052187:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0f81676200/0xcf8485587b8894b5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.052331:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0f81676200/0xcf8485587b8894b5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.052339:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81676200/0xcf8485587b8894b5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789683345.052352:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789683345.054779:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:9516:x1876618850109824:12345-0@lo:253: Request processed in 17137us (20592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683345.054838:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789683345.055043:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850109824:0@lo:253: 10000000:01000000:2.0:1789683345.055056:0:9516:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789683345.055059:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789683345.055061:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789683345.055062:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683345.055063:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789683345.055065:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683345.055066:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683345.055067:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683345.055069:0:9516:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789683345.055070:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683345.055071:0:9516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789683345.055090:0:9516:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0e827aa000 from lustre-OST0001 10000000:01000000:2.0:1789683345.055115:0:9516:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789683345.055118:0:9516:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789683345.055125:0:9516:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f0fa508b380 local copy 10000000:01000000:2.0:1789683345.055128:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789683345.055172:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b8894bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.055182:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b8894bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.055190:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b8894bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683345.055280:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850111744:0@lo:101: 00000100:00100000:2.0:1789683345.055313:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683345.055345:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb7922900 going to sleep for 11 seconds 00000100:00100000:3.0:1789683345.055689:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850111744 00000100:00100000:3.0:1789683345.055696:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850111744 00000100:00100000:3.0:1789683345.055745:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789683345.055754:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+14:9516:x1876618850111744:12345-0@lo:101: 00010000:00010000:3.0:1789683345.055769:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683345.055816:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f829e1000/0xcf8485587b8894c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8894bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.055841:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f829e1000/0xcf8485587b8894c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8894bc expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.055852:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f829e1000/0xcf8485587b8894c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8894bc expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.055871:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e1000, rc 0) 00000100:00100000:3.0:1789683345.055922:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:9516:x1876618850111744:12345-0@lo:101: Request processed in 159us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683345.055929:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789683345.056052:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850111744:0@lo:101: 00010000:00010000:2.0:1789683345.056064:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b8894bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcf8485587b8894c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.056074:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b8894bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf8485587b8894c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683345.056157:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850111872:0@lo:501: 00000100:00100000:2.0:1789683345.056182:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683345.056222:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb7922900 going to sleep for 11 seconds 00000100:00100000:3.0:1789683345.056368:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850111872 00000100:00100000:3.0:1789683345.056436:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850111872 00000100:00100000:3.0:1789683345.056470:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789683345.056477:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:9516:x1876618850111872:12345-0@lo:501: 00000100:00100000:3.0:1789683345.056530:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:9516:x1876618850111872:12345-0@lo:501: Request processed in 54us (347us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789683345.056536:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789683345.056598:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850111872:0@lo:501: 10000000:01000000:2.0:1789683345.056610:0:9516:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789683345.056628:0:9516:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789683345.056633:0:9516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b8894bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf8485587b8894c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.056641:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b8894bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf8485587b8894c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.056656:0:9516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b8894bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf8485587b8894c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.056716:0:9516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789683345.056741:0:9516:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0e827aa000 10000000:01000000:2.0:1789683345.056746:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789683345.056751:0:9516:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789683345.056754:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789683345.056758:0:9516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789683345.056760:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789683345.056778:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b8894ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.056815:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b8894ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.056823:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b8894ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683345.056837:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850112000:0@lo:101: 00000100:00100000:2.0:1789683345.056863:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683345.056881:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb79223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683345.057030:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850112000 00000100:00100000:1.0:1789683345.057035:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850112000 00000100:00100000:1.0:1789683345.057071:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789683345.057078:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:9516:x1876618850112000:12345-0@lo:101: 00010000:00010000:1.0:1789683345.057087:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683345.057097:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81676c00/0xcf8485587b8894d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8894ca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.057114:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81676c00/0xcf8485587b8894d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8894ca expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.057131:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81676c00/0xcf8485587b8894d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8894ca expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.057139:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81676c00, rc 0) 00000100:00100000:1.0:1789683345.057182:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9516:x1876618850112000:12345-0@lo:101: Request processed in 104us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683345.057188:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789683345.057333:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850112000:0@lo:101: 00010000:00010000:0.0:1789683345.057344:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b8894ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8894d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.057351:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b8894ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8894d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683345.057443:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850112128:0@lo:501: 00000100:00100000:0.0:1789683345.057471:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.057485:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc1500d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683345.057592:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850112128 00000100:00100000:2.0:1789683345.057597:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850112128 00000100:00100000:2.0:1789683345.057629:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789683345.057636:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9516:x1876618850112128:12345-0@lo:501: 00000100:00100000:2.0:1789683345.057744:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9516:x1876618850112128:12345-0@lo:501: Request processed in 108us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683345.057759:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789683345.057946:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850112128:0@lo:501: 00000100:00100000:0.0:1789683345.057972:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850112256:0@lo:503: 00000100:00100000:0.0:1789683345.058007:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.058029:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc1500d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683345.058087:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850112256 00000100:00100000:1.0:1789683345.058091:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850112256 00000100:00100000:1.0:1789683345.058122:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789683345.058127:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9516:x1876618850112256:12345-0@lo:503: 00000100:00100000:0.0:1789683345.058330:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850112256:0@lo:503: 00000040:00080000:0.0:1789683345.058570:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789683345.058634:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850112384:0@lo:502: 00000100:00100000:0.0:1789683345.058665:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.058675:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789683345.058691:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850112384 00000100:00100000:0.0:1789683345.058696:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850112384 00000100:00100000:0.0:1789683345.058713:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789683345.058719:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:9516:x1876618850112384:12345-0@lo:502: 00000100:00100000:0.0:1789683345.058816:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:9516:x1876618850112384:12345-0@lo:502: Request processed in 96us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683345.058831:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789683345.058869:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850112384:0@lo:502: 00000040:00080000:0.0:1789683345.059060:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789683345.059085:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789683345.059097:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789683345.059111:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789683345.059124:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789683345.059137:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789683345.059156:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850112512:0@lo:502: 00000100:00100000:0.0:1789683345.059190:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683345.059466:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9516:x1876618850112256:12345-0@lo:503: Request processed in 78us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683345.059476:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789683345.059569:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510e840 going to sleep for 11 seconds 00010000:00010000:3.0:1789683345.059650:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683345.059659:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b8894bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcf8485587b8894c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.059669:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8800 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683345.059674:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b8894bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcf8485587b8894c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.059684:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b8894bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcf8485587b8894c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683345.059693:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b8894bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcf8485587b8894c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683345.059700:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683345.059723:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b8894bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf8485587b8894c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.059740:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683345.059758:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b8894bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf8485587b8894c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.059765:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8800/0xcf8485587b8894bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf8485587b8894c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.059778:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683345.059780:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683345.059796:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683345.059805:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683345.059816:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850112640:0@lo:103: 00000100:00100000:3.0:1789683345.059849:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683345.060005:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850112512 00000100:00100000:1.0:1789683345.060012:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850112512 00000100:00100000:1.0:1789683345.060034:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789683345.060041:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9516:x1876618850112512:12345-0@lo:502: 00000100:00100000:1.0:1789683345.060129:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9516:x1876618850112512:12345-0@lo:502: Request processed in 88us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683345.060136:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789683345.064873:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850112640 00000100:00100000:0.0:1789683345.064889:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850112640 00000100:00100000:0.0:1789683345.064986:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683345.064998:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:3650:x1876618850112640:12345-0@lo:103: 00010000:00010000:0.0:1789683345.065016:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683345.065035:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f829e1000/0xcf8485587b8894c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b8894bc expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.065053:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683345.065134:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:3650:x1876618850112640:12345-0@lo:103: Request processed in 138us (5284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683345.065142:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683345.065185:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850112640:0@lo:103: 00000100:00100000:0.0:1789683345.065361:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850112512:0@lo:502: 00000040:00080000:0.0:1789683345.065524:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789683345.065550:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1789683345.066324:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789683345.066332:0:9529:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789683345.066338:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683345.066341:0:9529:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789683345.066347:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789683345.066360:0:9529:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9f0f86180000) 00000020:00000080:1.0:1789683345.066454:0:9529:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789683345.066463:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789683345.066528:0:9529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0e827aa000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789683345.066536:0:9529:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789683345.066541:0:9529:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf8485587b8894df 00010000:00010000:1.0:1789683345.072633:0:9529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1789683345.073142:0:9529:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789683345.076163:0:9529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789683345.076698:0:9529:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789683345.081687:0:9529:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1789683345.082005:0:9529:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789683345.088744:0:9529:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789683345.090128:0:9529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789683345.090142:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683345.090149:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683345.090152:0:9529:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789683345.090155:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683345.090159:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683345.090161:0:9529:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789683345.090164:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789683345.090166:0:9529:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789683345.090187:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683345.090189:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683345.090190:0:9529:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789683345.090193:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789683345.091498:0:9516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1789683345.091536:0:9516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789683345.091558:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b8894ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8894d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.091572:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b8894ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8894d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683345.091581:0:9516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0e827aa000 from 1 10000000:01000000:0.0:1789683345.091584:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789683345.091619:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81391a00/0xcf8485587b8894e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.091628:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f81391a00/0xcf8485587b8894e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.091640:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f81391a00/0xcf8485587b8894e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683345.091662:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850112768:0@lo:101: 00000100:00100000:0.0:1789683345.091723:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.091762:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789683345.091822:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850112768 00000100:00100000:0.0:1789683345.091829:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850112768 00000100:00100000:0.0:1789683345.091870:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789683345.091878:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:9516:x1876618850112768:12345-0@lo:101: 00010000:00010000:0.0:1789683345.091892:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683345.091903:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81390a00/0xcf8485587b8894ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8894e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.091950:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81390a00/0xcf8485587b8894ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8894e6 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.091961:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81390a00/0xcf8485587b8894ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8894e6 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.091971:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81390a00, rc 0) 00000100:00100000:0.0:1789683345.092010:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9516:x1876618850112768:12345-0@lo:101: Request processed in 132us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683345.092017:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789683345.092062:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850112768:0@lo:101: 00010000:00010000:0.0:1789683345.092075:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f81391a00/0xcf8485587b8894e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8894ed expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.092084:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f81391a00/0xcf8485587b8894e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8894ed expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683345.092166:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850112896:0@lo:501: 00000100:00100000:0.0:1789683345.092193:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.092205:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789683345.092220:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850112896 00000100:00100000:0.0:1789683345.092224:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850112896 00000100:00100000:0.0:1789683345.092246:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789683345.092252:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9516:x1876618850112896:12345-0@lo:501: 00000100:00100000:0.0:1789683345.092340:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9516:x1876618850112896:12345-0@lo:501: Request processed in 87us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683345.092346:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789683345.093747:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850112896:0@lo:501: 00000100:00100000:0.0:1789683345.093811:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850113024:0@lo:503: 00000100:00100000:0.0:1789683345.093870:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.093903:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83610600 going to sleep for 11 seconds 00000100:00100000:0.0:1789683345.093937:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850113024 00000100:00100000:0.0:1789683345.093943:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850113024 00000100:00100000:0.0:1789683345.093983:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789683345.093991:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9516:x1876618850113024:12345-0@lo:503: 00000100:00100000:0.0:1789683345.094089:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9516:x1876618850113024:12345-0@lo:503: Request processed in 99us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683345.094097:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789683345.094147:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850113024:0@lo:503: 00000040:00080000:0.0:1789683345.094947:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789683345.095019:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850113152:0@lo:502: 00000100:00100000:0.0:1789683345.095061:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.095121:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83610600 going to sleep for 11 seconds 00000100:00100000:2.0:1789683345.098721:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850113152 00000100:00100000:2.0:1789683345.098736:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850113152 00000100:00100000:2.0:1789683345.098805:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789683345.098815:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9516:x1876618850113152:12345-0@lo:502: 00000100:00100000:2.0:1789683345.098996:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9516:x1876618850113152:12345-0@lo:502: Request processed in 183us (3933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683345.099005:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789683345.099123:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850113152:0@lo:502: 00000040:00080000:0.0:1789683345.099384:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789683345.099421:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789683345.099456:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850113280:0@lo:502: 00000100:00100000:0.0:1789683345.099504:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.099543:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789683345.099951:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850113280 00000100:00100000:2.0:1789683345.099956:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850113280 00000100:00100000:2.0:1789683345.099990:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789683345.099997:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9516:x1876618850113280:12345-0@lo:502: 00000100:00100000:2.0:1789683345.100083:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9516:x1876618850113280:12345-0@lo:502: Request processed in 86us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683345.100097:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789683345.100240:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850113280:0@lo:502: 00000040:00080000:0.0:1789683345.100290:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789683345.100300:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789683345.100900:0:9533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683345.100920:0:9533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683345.100922:0:9533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789683345.100929:0:9533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0e827aa000 00000020:00000080:3.0:1789683345.100932:0:9533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789683345.100943:0:9533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683345.100945:0:9533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683345.100946:0:9533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789683345.100949:0:9533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789683345.101062:0:9516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789683345.101093:0:9516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789683345.101108:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81391a00/0xcf8485587b8894e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8894ed expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.101120:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f81391a00/0xcf8485587b8894e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8894ed expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683345.101162:0:9516:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789683345.101164:0:9516:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0e827aa000 10000000:01000000:0.0:1789683345.101167:0:9516:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0e827aa000 10000000:01000000:0.0:1789683345.101170:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789683345.101175:0:9516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0e827aa000 from 1 10000000:01000000:0.0:1789683345.101177:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789683345.101319:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b8894f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.101328:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b8894f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.101338:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b8894f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683345.101353:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850113408:0@lo:101: 00000100:00100000:0.0:1789683345.101402:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.101434:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83610540 going to sleep for 11 seconds 00000100:00100000:3.0:1789683345.101537:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850113408 00000100:00100000:3.0:1789683345.101543:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850113408 00000100:00100000:3.0:1789683345.101578:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789683345.101585:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9516:x1876618850113408:12345-0@lo:101: 00010000:00010000:3.0:1789683345.101595:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683345.101605:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8894fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8894f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.101635:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8894fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8894f4 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.101645:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8894fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8894f4 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683345.101654:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e0800, rc 0) 00000100:00100000:3.0:1789683345.101683:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:9516:x1876618850113408:12345-0@lo:101: Request processed in 99us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683345.101690:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789683345.101852:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850113408:0@lo:101: 00010000:00010000:0.0:1789683345.101864:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b8894f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8894fb expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.101873:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b8894f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8894fb expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683345.101952:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850113536:0@lo:501: 00000100:00100000:0.0:1789683345.101975:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.101990:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83610540 going to sleep for 11 seconds 00000100:00100000:2.0:1789683345.102035:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850113536 00000100:00100000:2.0:1789683345.102040:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850113536 00000100:00100000:2.0:1789683345.102066:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789683345.102072:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:9516:x1876618850113536:12345-0@lo:501: 00000100:00100000:2.0:1789683345.102161:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:9516:x1876618850113536:12345-0@lo:501: Request processed in 88us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683345.102167:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789683345.102350:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850113536:0@lo:501: 00000100:00100000:0.0:1789683345.102385:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850113664:0@lo:503: 00000100:00100000:0.0:1789683345.102420:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.102439:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83610540 going to sleep for 11 seconds 00000100:00100000:2.0:1789683345.102529:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850113664 00000100:00100000:2.0:1789683345.102533:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850113664 00000100:00100000:2.0:1789683345.102561:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789683345.102566:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:9516:x1876618850113664:12345-0@lo:503: 00000100:00100000:2.0:1789683345.102643:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:9516:x1876618850113664:12345-0@lo:503: Request processed in 76us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683345.102650:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789683345.102714:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850113664:0@lo:503: 00000040:00080000:3.0:1789683345.102953:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789683345.103000:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850113792:0@lo:502: 00000100:00100000:3.0:1789683345.103031:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683345.103048:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc05e9240 going to sleep for 11 seconds 00000100:00100000:2.0:1789683345.103097:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850113792 00000100:00100000:2.0:1789683345.103101:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850113792 00000100:00100000:2.0:1789683345.103126:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789683345.103131:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:9516:x1876618850113792:12345-0@lo:502: 00000100:00100000:2.0:1789683345.103191:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:9516:x1876618850113792:12345-0@lo:502: Request processed in 59us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683345.103318:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789683345.103487:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850113792:0@lo:502: 00000040:00080000:3.0:1789683345.103656:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789683345.103679:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789683345.103690:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789683345.103701:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789683345.103711:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789683345.103721:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789683345.103732:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789683345.103742:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789683345.103753:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789683345.103775:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789683345.103817:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789683345.103837:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789683345.103847:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789683345.103858:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789683345.103868:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789683345.103878:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789683345.103889:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789683345.103899:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789683345.103919:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789683345.103935:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789683345.103948:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789683345.103960:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789683345.103972:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789683345.103985:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789683345.103997:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789683345.104021:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789683345.104037:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789683345.104047:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1789683345.104057:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789683345.104068:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1789683345.104079:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1789683345.104091:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1789683345.104103:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1789683345.104115:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1789683345.104127:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1789683345.104139:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1789683345.104152:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1789683345.104162:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1789683345.104174:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1789683345.104185:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1789683345.106364:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1789683345.106508:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1789683345.106527:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1789683345.106540:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1789683345.106567:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1789683345.106581:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1789683345.106630:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850113920:0@lo:502: 00000100:00100000:3.0:1789683345.106710:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683345.106758:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc05e9240 going to sleep for 11 seconds 00000100:00100000:2.0:1789683345.107323:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850113920 00000100:00100000:2.0:1789683345.107332:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850113920 00000100:00100000:2.0:1789683345.107399:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789683345.107408:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:9516:x1876618850113920:12345-0@lo:502: 00000100:00100000:2.0:1789683345.107539:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:9516:x1876618850113920:12345-0@lo:502: Request processed in 131us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683345.107546:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789683345.108947:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850113920:0@lo:502: 00000040:00080000:2.0:1789683345.109039:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1789683345.109053:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1789683345.110600:0:9534:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789683345.110619:0:9534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9f0fb5048000) 00000020:00000080:2.0:1789683345.110644:0:9534:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1789683345.110720:0:9534:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0e827aa000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789683345.110725:0:9534:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0e827aa000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789683345.110727:0:9534:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0e827aa000 3 00010000:00080000:2.0:1789683345.110755:0:9534:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0e83442000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.150@tcp at head 00010000:00010000:2.0:1789683345.113728:0:9534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1789683345.114131:0:9534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789683345.114179:0:9534:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789683345.114203:0:9534:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcf8485587b889509 00000100:00080000:2.0:1789683345.114222:0:9534:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789683345.114235:0:9534:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f0e83442000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683345.114274:0:9534:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc0bdb100 x1876618850114048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789683345.114304:0:9534:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789683345.114609:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850114560:0@lo:400: 00000100:00100000:0.0:1789683345.114675:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.114709:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850115072:0@lo:400: 00000100:00100000:0.0:1789683345.114732:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.114754:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789683345.114760:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850114176:0@lo:400: 00000100:00100000:0.0:1789683345.114822:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.114841:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850114688:0@lo:400: 00000100:00100000:0.0:1789683345.114863:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.114888:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850114304:0@lo:400: 00000100:00100000:0.0:1789683345.114937:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.114956:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850114816:0@lo:400: 00000100:00100000:0.0:1789683345.114974:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.114991:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789683345.114996:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850114432:0@lo:400: 00000100:00100000:0.0:1789683345.115016:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.115043:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850114944:0@lo:400: 00000100:00100000:0.0:1789683345.115065:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.115098:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850114560 00000100:00100000:0.0:1789683345.115105:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850114560 00000100:00100000:0.0:1789683345.115144:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850114304 00000100:00100000:0.0:1789683345.115147:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850114304 00000100:00100000:0.0:1789683345.115163:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789683345.115180:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850114560:12345-0@lo:400: 00000100:00100000:0.0:1789683345.115248:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850114560:12345-0@lo:400: Request processed in 69us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683345.115255:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789683345.115270:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789683345.115276:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850114304:12345-0@lo:400: 00000100:00100000:0.0:1789683345.115308:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850114304:12345-0@lo:400: Request processed in 32us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683345.115313:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789683345.115332:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850115072 00000100:00100000:0.0:1789683345.115335:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850115072 00000100:00100000:0.0:1789683345.115367:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850114944 00000100:00100000:0.0:1789683345.115370:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850114944 00000100:00100000:0.0:1789683345.115768:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789683345.115776:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850115072:12345-0@lo:400: 00000100:00100000:0.0:1789683345.115837:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850115072:12345-0@lo:400: Request processed in 63us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683345.115844:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789683345.115857:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789683345.115863:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850114944:12345-0@lo:400: 00000100:00100000:0.0:1789683345.115892:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850114944:12345-0@lo:400: Request processed in 29us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683345.115907:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789683345.115941:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850114176 00000100:00100000:0.0:1789683345.115947:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850114176 00000100:00100000:0.0:1789683345.115966:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850114688 00000100:00100000:0.0:1789683345.115968:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850114688 00000100:00100000:0.0:1789683345.115982:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850114816 00000100:00100000:0.0:1789683345.115984:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850114816 00000100:00100000:0.0:1789683345.115996:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850114432 00000100:00100000:0.0:1789683345.115998:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850114432 00000100:00100000:0.0:1789683345.116011:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789683345.116017:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850114176:12345-0@lo:400: 00000100:00100000:0.0:1789683345.116049:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850114176:12345-0@lo:400: Request processed in 32us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683345.116055:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789683345.116066:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789683345.116073:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850114688:12345-0@lo:400: 00000100:00100000:0.0:1789683345.116100:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850114688:12345-0@lo:400: Request processed in 28us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683345.116105:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789683345.116115:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789683345.116122:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850114816:12345-0@lo:400: 00000100:00100000:0.0:1789683345.116149:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850114816:12345-0@lo:400: Request processed in 28us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683345.116155:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789683345.116165:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789683345.116171:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850114432:12345-0@lo:400: 00000100:00100000:0.0:1789683345.116197:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850114432:12345-0@lo:400: Request processed in 27us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683345.116512:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789683345.116630:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683345.116634:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683345.116637:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683345.116858:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1876618850114048:0@lo:38: 00000100:00100000:3.0:1789683345.116901:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683345.116959:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850114048 00000100:00100000:3.0:1789683345.116964:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850114048 00000100:00100000:3.0:1789683345.116987:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683345.116991:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1876618850114048:12345-0@lo:38: 00010000:00080000:3.0:1789683345.117011:0:6523:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:3.0:1789683345.117043:0:6523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcf8485587b889510 00000004:00100000:3.0:1789683345.117057:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789683345.117085:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9f0e82757000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683345.117127:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876618850114048:12345-0@lo:38: Request processed in 134us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683345.117132:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789683345.117169:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc0bdb100 x1876618850114048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683345.117180:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789683345.117188:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789683345.117213:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789683345.117217:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789683345.117220:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83442000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789683345.117226:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1876618850114048:0@lo:38: 00010000:00080000:0.0:1789683345.117626:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc14af480 x1876618850114432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683345.117637:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850114432:0@lo:400: 00010000:00080000:0.0:1789683345.117650:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc14aca80 x1876618850114944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683345.117658:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850114944:0@lo:400: 00000100:00100000:0.0:1789683345.117669:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850114304:0@lo:400: 00010000:00080000:0.0:1789683345.117680:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc14afb80 x1876618850114816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683345.117688:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850114816:0@lo:400: 00010000:00080000:0.0:1789683345.117723:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc14ad880 x1876618850114176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683345.117733:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850114176:0@lo:400: 00010000:00080000:0.0:1789683345.117743:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc14aed80 x1876618850114688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683345.117751:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850114688:0@lo:400: 00000100:00100000:0.0:1789683345.117762:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850114560:0@lo:400: 00010000:00080000:0.0:1789683345.117773:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc14adf80 x1876618850115072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683345.117807:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850115072:0@lo:400: 00000020:01000004:3.0:1789683345.123637:0:9534:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789683345.123675:0:9534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9f0fc1244d40) 00000020:00000080:3.0:1789683345.123700:0:9534:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1789683345.123821:0:9534:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0e827aa000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789683345.123826:0:9534:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0e827aa000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789683345.123828:0:9534:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0e827aa000 3 00010000:00080000:3.0:1789683345.123860:0:9534:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0e82752000@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.150@tcp at head 00010000:00010000:3.0:1789683345.126146:0:9534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1789683345.126359:0:9534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789683345.126406:0:9534:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789683345.126421:0:9534:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xcf8485587b88951e 00000100:00080000:3.0:1789683345.126432:0:9534:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683345.126445:0:9534:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f0e82752000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683345.126483:0:9534:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb7960700 x1876618850115200/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789683345.126526:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1876618850115200:0@lo:38: 00000100:00100000:3.0:1789683345.126595:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789683345.126649:0:9534:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789683345.128124:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850115200 00000100:00100000:0.0:1789683345.128136:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850115200 00000100:00100000:0.0:1789683345.128177:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789683345.128186:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876618850115200:12345-0@lo:38: 00010000:00080000:0.0:1789683345.128250:0:6521:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:0.0:1789683345.128286:0:6521:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xcf8485587b889525 00000004:00100000:0.0:1789683345.128303:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789683345.128337:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9f0fb635d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683345.128428:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876618850115200:12345-0@lo:38: Request processed in 242us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683345.128436:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789683345.128615:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb7960700 x1876618850115200/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683345.128627:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789683345.128635:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789683345.128643:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789683345.128647:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789683345.128650:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e82752000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789683345.128657:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1876618850115200:0@lo:38: 00000100:00100000:2.0:1789683345.133314:0:9535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd9f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9535:1876618850115328:0@lo:901: 00000100:00100000:2.0:1789683345.133535:0:9535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683345.133593:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850115328 00000100:00100000:2.0:1789683345.133600:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850115328 00000100:00100000:2.0:1789683345.133666:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789683345.133681:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9535:x1876618850115328:12345-0@lo:901: 00000100:00100000:2.0:1789683345.133766:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9535:x1876618850115328:12345-0@lo:901: Request processed in 85us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683345.133773:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789683345.133826:0:9535:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb7922900 going to sleep for 11 seconds 00010000:00080000:2.0:1789683345.133853:0:9535:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc0bd9f80 x1876618850115328/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789683361 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683345.133867:0:9535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd9f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9535:1876618850115328:0@lo:901: 00000100:00080000:1.0:1789683345.134097:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1789683345.141029:0:9534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1789683345.141921:0:9516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1789683345.141967:0:9516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789683345.141991:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b8894f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8894fb expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.142020:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b8894f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8894fb expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789683345.142067:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789683345.142070:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789683345.142071:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683345.142072:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683345.142073:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683345.142074:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683345.142076:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683345.142077:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789683345.142078:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789683345.142080:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683345.142082:0:9516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789683345.142087:0:9516:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1789683345.142089:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789683345.142090:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789683345.142091:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683345.142092:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683345.142093:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683345.142094:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683345.142095:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683345.142095:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789683345.142096:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789683345.142097:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683345.142098:0:9516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789683345.142126:0:9516:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789683345.142146:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850115456:0@lo:253: 00000100:00100000:0.0:1789683345.142338:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683345.142455:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850115456 00000100:00100000:2.0:1789683345.142463:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850115456 00000100:00100000:2.0:1789683345.142508:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789683345.142517:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:9516:x1876618850115456:12345-0@lo:253: 20000000:01000000:2.0:1789683345.142545:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789683345.142561:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789683345.142695:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83610600 going to sleep for 11 seconds 20000000:01000000:2.0:1789683345.147582:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789683345.147604:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789683345.147717:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789683345.147723:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789683345.147744:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88952c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.147763:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fa01f9800/0xcf8485587b889422 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88941b expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.147772:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f80030c00/0xcf8485587b889468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889461 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.147779:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88952c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.147850:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f80030c00/0xcf8485587b889468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b889461 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.147864:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f80030c00/0xcf8485587b889468 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b889461 expref: 17 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683345.147879:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876618850115584:0@lo:104: 00000100:00100000:1.0:1789683345.147957:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683345.148016:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fa01f9800/0xcf8485587b889422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88941b expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683345.148025:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0fa01f9800/0xcf8485587b889422 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88941b expref: 17 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683345.148033:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876618850115712:0@lo:104: 00000100:00100000:1.0:1789683345.148056:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683345.148074:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc06803c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683345.148256:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850115584 00000100:00100000:2.0:1789683345.148264:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850115584 00000100:00100000:2.0:1789683345.148302:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850115712 00000100:00100000:2.0:1789683345.148305:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850115712 00000100:00100000:2.0:1789683345.148318:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789683345.148326:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:6537:x1876618850115584:12345-0@lo:104: 00010000:00010000:2.0:1789683345.148338:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b889461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889468 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.148409:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789683345.148415:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:6537:x1876618850115584:12345-0@lo:104: Request processed in 90us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683345.148428:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789683345.148446:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789683345.148451:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:6537:x1876618850115712:12345-0@lo:104: 00010000:00010000:2.0:1789683345.148459:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88941b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889422 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683345.148492:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789683345.148497:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:6537:x1876618850115712:12345-0@lo:104: Request processed in 47us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683345.148503:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789683345.148555:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:9516:x1876618850115456:12345-0@lo:253: Request processed in 6039us (6218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683345.148564:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789683345.148751:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876618850115584:0@lo:104: 00000100:00100000:1.0:1789683345.148760:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876618850115712:0@lo:104: 00010000:00010000:1.0:1789683345.148780:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88952c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.148873:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683345.148880:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b889461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889468 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.148887:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f829e0c00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683345.148898:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b889461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b889468 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.148906:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b889461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b889468 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683345.148925:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b889461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b889468 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683345.148930:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789683345.148963:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b889461 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889468 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.148969:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683345.148998:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b889461 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889468 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149005:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b889461 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889468 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149018:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683345.149021:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88941b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889422 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149027:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8400 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683345.149030:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88941b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b889422 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149037:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88941b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b889422 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683345.149054:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88941b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b889422 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683345.149058:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789683345.149074:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88941b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889422 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149079:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683345.149092:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88941b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889422 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149098:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b88941b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889422 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149110:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683345.149111:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683345.149113:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683345.149120:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683345.149131:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850115840:0@lo:103: 00000100:00100000:0.0:1789683345.149164:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.149212:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850115968:0@lo:103: 00000100:00100000:0.0:1789683345.149236:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683345.149268:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850115840 00000100:00100000:0.0:1789683345.149272:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850115840 00010000:00010000:0.0:1789683345.149291:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f80030c00/0xcf8485587b889468 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889461 expref: 17 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683345.149310:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850115968 00000100:00100000:0.0:1789683345.149313:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850115968 00010000:00010000:0.0:1789683345.149330:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fa01f9800/0xcf8485587b889422 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88941b expref: 18 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683345.149342:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789683345.149347:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:3649:x1876618850115840:12345-0@lo:103: 00010000:00010000:0.0:1789683345.149357:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683345.149361:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f80030c00/0xcf8485587b889468 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889461 expref: 18 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149523:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f80030c00/0xcf8485587b889468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b889461 expref: 18 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149538:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f80030c00/0xcf8485587b889468 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b889461 expref: 18 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149549:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683345.149589:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:3649:x1876618850115840:12345-0@lo:103: Request processed in 241us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683345.149595:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789683345.149608:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789683345.149614:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:3647:x1876618850115968:12345-0@lo:103: 00010000:00010000:0.0:1789683345.149622:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683345.149626:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fa01f9800/0xcf8485587b889422 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88941b expref: 16 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149634:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fa01f9800/0xcf8485587b889422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88941b expref: 16 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149643:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f9800/0xcf8485587b889422 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88941b expref: 16 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149663:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88952c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149670:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88952c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789683345.149684:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012087750s 00010000:00010000:0.0:1789683345.149689:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88952c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149696:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88952c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149703:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88952c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149709:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88952c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149713:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677a00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683345.149718:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88952c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149724:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88952c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149737:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88952c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149745:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683345.149776:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:3647:x1876618850115968:12345-0@lo:103: Request processed in 162us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683345.149810:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789683345.149844:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850115968:0@lo:103: 00010000:00010000:0.0:1789683345.149871:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88952c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149879:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88952c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683345.149886:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88952c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683345.149931:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9516:1876618850115456:0@lo:253: 10000000:01000000:0.0:1789683345.149941:0:9516:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789683345.149945:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789683345.149946:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789683345.149948:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683345.149949:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683345.149950:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683345.149951:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683345.149953:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683345.149955:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789683345.149956:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789683345.149958:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683345.149959:0:9516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789683345.149969:0:9516:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789683345.150321:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850115840:0@lo:103: 00010000:00010000:2.0:1789683345.150899:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1789683345.156476:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789683345.158739:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789683345.159488:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789683345.159635:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789683345.160137:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789683345.160547:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1789683345.161737:0:9516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789683345.179585:0:9516:0:(ofd_obd.c:547:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789683345.179594:0:9516:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789683345.179629:0:9516:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789683345.179674:0:9516:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789683345.179690:0:9516:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789683345.179713:0:9516:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789683345.187761:0:9516:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789683345.188052:0:9516:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789683345.447495:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789683346.125487:0:9590:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789683346.125717:0:9590:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789683346.463033:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683347.490570:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683348.063066:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850116096:0@lo:41: 00000100:00100000:0.0:1789683348.063147:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683348.063288:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850116096 00000100:00100000:2.0:1789683348.063296:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850116096 00000100:00100000:2.0:1789683348.063342:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789683348.063351:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850116096:12345-0@lo:41: 00000004:00000024:2.0:1789683348.063384:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789683348.063435:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850116096:12345-0@lo:41: Request processed in 85us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683348.063442:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789683348.063500:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850116096:0@lo:41: 00010000:00010000:3.0:1789683348.513041:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683348.575687:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850116224:0@lo:13: 00000100:00100000:1.0:1789683348.575768:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683348.575932:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850116224 00000100:00100000:0.0:1789683348.575941:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850116224 00000100:00100000:0.0:1789683348.576006:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789683348.576017:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850116224:12345-0@lo:13: 00002000:00000024:0.0:1789683348.576048:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683348.576101:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850116224:12345-0@lo:13: Request processed in 87us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683348.576108:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789683348.576147:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7962a00 x1876618850116224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683348.576165:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850116224:0@lo:13: 00000100:00080000:1.0:1789683348.576221:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683349.090513:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850116352:0@lo:41: 00000100:00100000:3.0:1789683349.090586:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683349.093805:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850116352 00000100:00100000:1.0:1789683349.093815:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850116352 00000100:00100000:1.0:1789683349.093886:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789683349.093896:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850116352:12345-0@lo:41: 00000004:00000024:1.0:1789683349.093932:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1789683349.095354:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850116480:0@lo:13: 00000100:00100000:2.0:1789683349.095409:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683349.095480:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850116480 00000100:00100000:2.0:1789683349.095486:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850116480 00000100:00100000:2.0:1789683349.095532:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789683349.095545:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850116480:12345-0@lo:13: 00002000:00000024:2.0:1789683349.095565:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683349.095603:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850116480:12345-0@lo:13: Request processed in 60us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683349.095610:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789683349.095630:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789683349.095655:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7244700 x1876618850116480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683349.095673:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850116480:0@lo:13: 00000100:00100000:1.0:1789683349.099007:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850116352:12345-0@lo:41: Request processed in 5103us (8411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683349.099025:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789683349.102259:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850116352:0@lo:41: 00010000:00010000:2.0:1789683349.538585:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683350.559996:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683350.625111:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850116992:0@lo:400: 00000100:00100000:2.0:1789683350.625184:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.625229:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850117504:0@lo:400: 00000100:00100000:2.0:1789683350.625270:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.625304:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789683350.625311:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850116608:0@lo:400: 00000100:00100000:2.0:1789683350.625341:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.625360:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850117120:0@lo:400: 00000100:00100000:2.0:1789683350.625383:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.625402:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850117632:0@lo:400: 00000100:00100000:2.0:1789683350.625422:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.625449:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850116736:0@lo:400: 00000100:00100000:2.0:1789683350.625470:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.625485:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850117248:0@lo:400: 00000100:00100000:2.0:1789683350.625505:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.625532:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850117760:0@lo:400: 00000100:00100000:2.0:1789683350.625551:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.625570:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789683350.625576:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850116864:0@lo:400: 00000100:00100000:2.0:1789683350.625598:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.625612:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850117376:0@lo:400: 00000100:00100000:2.0:1789683350.625630:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.625640:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850117888:0@lo:400: 00000100:00100000:2.0:1789683350.625662:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.625684:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850117504 00000100:00100000:2.0:1789683350.625692:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850117504 00000100:00100000:2.0:1789683350.625741:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850117632 00000100:00100000:2.0:1789683350.625745:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850117632 00000100:00100000:2.0:1789683350.625765:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789683350.625773:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850117504:12345-0@lo:400: 00000100:00100000:2.0:1789683350.625860:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850117504:12345-0@lo:400: Request processed in 87us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.625867:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789683350.625885:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789683350.625891:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850117632:12345-0@lo:400: 00000100:00100000:2.0:1789683350.625916:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850117632:12345-0@lo:400: Request processed in 26us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.625922:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789683350.625938:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850117120 00000100:00100000:2.0:1789683350.625941:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850117120 00000100:00100000:2.0:1789683350.625958:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850116864 00000100:00100000:2.0:1789683350.625961:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850116864 00000100:00100000:2.0:1789683350.625971:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789683350.625982:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850117120:12345-0@lo:400: 00000100:00100000:2.0:1789683350.626011:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850117120:12345-0@lo:400: Request processed in 30us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.626017:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789683350.626027:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789683350.626032:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850116864:12345-0@lo:400: 00000100:00100000:2.0:1789683350.626057:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850116864:12345-0@lo:400: Request processed in 25us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.626062:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789683350.626080:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850116992 00000100:00100000:2.0:1789683350.626083:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850116992 00000100:00100000:2.0:1789683350.626097:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850116736 00000100:00100000:2.0:1789683350.626099:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850116736 00000100:00100000:2.0:1789683350.626106:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850117248 00000100:00100000:2.0:1789683350.626108:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850117248 00000100:00100000:2.0:1789683350.626118:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850117760 00000100:00100000:2.0:1789683350.626120:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850117760 00000100:00100000:2.0:1789683350.626130:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850117376 00000100:00100000:2.0:1789683350.626133:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850117376 00000100:00100000:2.0:1789683350.626143:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850117888 00000100:00100000:2.0:1789683350.626145:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850117888 00000100:00100000:2.0:1789683350.626156:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789683350.626161:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850116992:12345-0@lo:400: 00000100:00100000:2.0:1789683350.626189:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850116992:12345-0@lo:400: Request processed in 28us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.626195:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789683350.626206:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789683350.626211:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850116736:12345-0@lo:400: 00000100:00100000:2.0:1789683350.626238:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850116736:12345-0@lo:400: Request processed in 27us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.626250:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789683350.626263:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789683350.626269:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850117248:12345-0@lo:400: 00000100:00100000:2.0:1789683350.626297:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850117248:12345-0@lo:400: Request processed in 29us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.626303:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789683350.626314:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789683350.626320:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850117760:12345-0@lo:400: 00000100:00100000:2.0:1789683350.626345:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850117760:12345-0@lo:400: Request processed in 25us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.626350:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789683350.626361:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789683350.626367:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850117376:12345-0@lo:400: 00000100:00100000:2.0:1789683350.626392:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850117376:12345-0@lo:400: Request processed in 26us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.626397:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789683350.626407:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789683350.626412:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850117888:12345-0@lo:400: 00000100:00100000:2.0:1789683350.626437:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850117888:12345-0@lo:400: Request processed in 25us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.626442:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1789683350.626465:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789683350.626468:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683350.626471:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683350.626504:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850116864:0@lo:400: 00010000:00080000:2.0:1789683350.626528:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0bd8000 x1876618850117376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683350.626537:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850117376:0@lo:400: 00010000:00080000:2.0:1789683350.626546:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f89083b80 x1876618850117888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683350.626554:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850117888:0@lo:400: 00010000:00080000:2.0:1789683350.626562:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0bd9500 x1876618850116736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683350.626569:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850116736:0@lo:400: 00010000:00080000:2.0:1789683350.626578:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0bdb100 x1876618850117248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683350.626585:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850117248:0@lo:400: 00010000:00080000:2.0:1789683350.626593:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f89081880 x1876618850117760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683350.626599:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850117760:0@lo:400: 00000100:00100000:2.0:1789683350.626636:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850117120:0@lo:400: 00010000:00080000:2.0:1789683350.626646:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0bdb480 x1876618850117632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683350.626654:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850117632:0@lo:400: 00010000:00080000:2.0:1789683350.626662:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0bd8380 x1876618850116992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683350.626669:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850116992:0@lo:400: 00010000:00080000:2.0:1789683350.626689:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0bd8e00 x1876618850117504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683350.626697:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850117504:0@lo:400: 10000000:01000000:1.0:1789683350.626821:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789683350.626825:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0fb62ea800 from 39 10000000:01000000:1.0:1789683350.626829:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789683350.626861:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81676200/0xcf8485587b889533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.626872:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f81676200/0xcf8485587b889533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.626883:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f81676200/0xcf8485587b889533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683350.626898:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850118016:0@lo:101: 00000100:00100000:1.0:1789683350.626932:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683350.626960:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc0775180 going to sleep for 11 seconds 00000100:00100000:1.0:1789683350.626976:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850116608 00000100:00100000:1.0:1789683350.626981:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850116608 00000100:00100000:1.0:1789683350.627009:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850118016 00000100:00100000:1.0:1789683350.627012:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850118016 00000100:00100000:1.0:1789683350.627026:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789683350.627033:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:3647:x1876618850116608:12345-0@lo:400: 00000100:00100000:1.0:1789683350.627069:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:3647:x1876618850116608:12345-0@lo:400: Request processed in 37us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683350.627075:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789683350.627098:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789683350.627105:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:6518:x1876618850118016:12345-0@lo:101: 00010000:00010000:1.0:1789683350.627112:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683350.627130:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88953a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889533 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.627151:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88953a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889533 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.627162:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88953a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889533 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.627172:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81677a00, rc 0) 00000100:00100000:1.0:1789683350.627201:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850118016:12345-0@lo:101: Request processed in 97us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683350.627207:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789683350.627245:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850118016:0@lo:101: 00010000:00010000:1.0:1789683350.627258:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f81676200/0xcf8485587b889533 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88953a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.627268:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f81676200/0xcf8485587b889533 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88953a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683350.627321:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850118144:0@lo:501: 00000100:00100000:1.0:1789683350.627346:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683350.627358:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f925050c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683350.627369:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850118144 00000100:00100000:1.0:1789683350.627373:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850118144 00000100:00100000:1.0:1789683350.627390:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789683350.627396:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850118144:12345-0@lo:501: 00000100:00100000:1.0:1789683350.627515:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850118144:12345-0@lo:501: Request processed in 119us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683350.627532:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789683350.627564:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850118144:0@lo:501: 00000100:00100000:1.0:1789683350.627589:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850118272:0@lo:503: 00000100:00100000:1.0:1789683350.627626:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683350.627639:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f925050c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683350.627657:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850116608:0@lo:400: 00000100:00100000:1.0:1789683350.627673:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850118272 00000100:00100000:1.0:1789683350.627676:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850118272 00000100:00100000:1.0:1789683350.627693:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789683350.627699:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850118272:12345-0@lo:503: 00000100:00100000:1.0:1789683350.627774:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850118272:12345-0@lo:503: Request processed in 74us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683350.627780:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789683350.627857:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850118272:0@lo:503: 00000100:00100000:1.0:1789683350.628072:0:9844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9844:1876618850118400:0@lo:502: 00000100:00100000:1.0:1789683350.628108:0:9844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683350.628126:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850118400 00000100:00100000:1.0:1789683350.628130:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850118400 00000100:00100000:1.0:1789683350.628150:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789683350.628156:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9844:x1876618850118400:12345-0@lo:502: 00000100:00100000:1.0:1789683350.628224:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9844:x1876618850118400:12345-0@lo:502: Request processed in 67us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683350.628230:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789683350.628257:0:9844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc0775180 going to sleep for 11 seconds 00000100:00100000:1.0:1789683350.628273:0:9844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9844:1876618850118400:0@lo:502: 00000100:00100000:1.0:1789683350.628308:0:9844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9844:1876618850118528:0@lo:502: 00000100:00100000:1.0:1789683350.628340:0:9844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683350.628357:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850118528 00000100:00100000:1.0:1789683350.628360:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850118528 00000100:00100000:1.0:1789683350.628378:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789683350.628383:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9844:x1876618850118528:12345-0@lo:502: 00000100:00100000:1.0:1789683350.628437:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:9844:x1876618850118528:12345-0@lo:502: Request processed in 53us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683350.628443:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789683350.628470:0:9844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49000 going to sleep for 11 seconds 00000100:00100000:1.0:1789683350.628482:0:9844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9844:1876618850118528:0@lo:502: 00000040:00080000:1.0:1789683350.628499:0:9844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789683350.628546:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789683350.628560:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789683350.628569:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81676200/0xcf8485587b889533 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88953a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.628579:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f81676200/0xcf8485587b889533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88953a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683350.628587:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789683350.628589:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789683350.628591:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789683350.628610:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.628617:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.628632:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683350.628644:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850118656:0@lo:101: 00000100:00100000:1.0:1789683350.628669:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683350.628682:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49000 going to sleep for 11 seconds 00000100:00100000:1.0:1789683350.628694:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850118656 00000100:00100000:1.0:1789683350.628697:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850118656 00000100:00100000:1.0:1789683350.628719:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789683350.628725:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850118656:12345-0@lo:101: 00010000:00010000:1.0:1789683350.628733:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683350.628743:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81676e00/0xcf8485587b889548 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889541 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.628758:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81676e00/0xcf8485587b889548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889541 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.628768:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81676e00/0xcf8485587b889548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889541 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.628775:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81676e00, rc 0) 00000100:00100000:1.0:1789683350.628841:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850118656:12345-0@lo:101: Request processed in 115us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683350.628847:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789683350.628875:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850118656:0@lo:101: 00010000:00010000:1.0:1789683350.628886:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889541 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889548 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.628904:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889541 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889548 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683350.628940:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850118784:0@lo:501: 00000100:00100000:1.0:1789683350.628963:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683350.628974:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49000 going to sleep for 11 seconds 00000100:00100000:1.0:1789683350.628985:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850118784 00000100:00100000:1.0:1789683350.628988:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850118784 00000100:00100000:1.0:1789683350.629005:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789683350.629010:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850118784:12345-0@lo:501: 00000100:00100000:1.0:1789683350.629083:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850118784:12345-0@lo:501: Request processed in 72us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683350.629089:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789683350.629115:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850118784:0@lo:501: 00000100:00100000:1.0:1789683350.629135:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850118912:0@lo:503: 00000100:00100000:1.0:1789683350.629163:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683350.629174:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49000 going to sleep for 11 seconds 00000100:00100000:1.0:1789683350.629183:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850118912 00000100:00100000:1.0:1789683350.629186:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850118912 00000100:00100000:1.0:1789683350.629203:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789683350.629207:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850118912:12345-0@lo:503: 00000100:00100000:1.0:1789683350.629269:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850118912:12345-0@lo:503: Request processed in 60us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683350.629275:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789683350.629308:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850118912:0@lo:503: 00000100:00100000:1.0:1789683350.629511:0:9845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9845:1876618850119040:0@lo:502: 00000100:00100000:1.0:1789683350.629543:0:9845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683350.629560:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850119040 00000100:00100000:1.0:1789683350.629563:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850119040 00000100:00100000:1.0:1789683350.629584:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789683350.629590:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f93123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:9845:x1876618850119040:12345-0@lo:502: 00000100:00100000:1.0:1789683350.629650:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f93123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:9845:x1876618850119040:12345-0@lo:502: Request processed in 59us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683350.629657:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789683350.629686:0:9845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683350.629697:0:9845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9845:1876618850119040:0@lo:502: 00000020:01000000:1.0:1789683350.629715:0:9845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683350.629722:0:9845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683350.629724:0:9845:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789683350.629729:0:9845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789683350.629731:0:9845:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789683350.629744:0:9845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9845:1876618850119168:0@lo:502: 00000100:00100000:1.0:1789683350.629776:0:9845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.636934:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850119168 00000100:00100000:2.0:1789683350.636950:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850119168 00000100:00100000:2.0:1789683350.637015:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789683350.637025:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:9845:x1876618850119168:12345-0@lo:502: 00000100:00100000:2.0:1789683350.637217:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:9845:x1876618850119168:12345-0@lo:502: Request processed in 192us (7439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.637225:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789683350.642217:0:9845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683350.642277:0:9845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9845:1876618850119168:0@lo:502: 00000020:01000000:1.0:1789683350.642321:0:9845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683350.642332:0:9845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683350.642334:0:9845:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789683350.642338:0:9845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789683350.642715:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789683350.642737:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789683350.642748:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889541 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889548 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683350.642760:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889548 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683350.642809:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789683350.642821:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0f88c59000 from 39 10000000:01000000:0.0:1789683350.642824:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789683350.642860:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81390e00/0xcf8485587b88954f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683350.642869:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f81390e00/0xcf8485587b88954f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683350.642878:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f81390e00/0xcf8485587b88954f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683350.642899:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850119296:0@lo:101: 00000100:00100000:0.0:1789683350.642960:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683350.642996:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8bb9c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683350.649366:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850119296 00000100:00100000:1.0:1789683350.649380:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850119296 00000100:00100000:1.0:1789683350.649442:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789683350.649454:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850119296:12345-0@lo:101: 00010000:00010000:1.0:1789683350.649479:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683350.649498:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81677200/0xcf8485587b889556 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88954f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.649527:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81677200/0xcf8485587b889556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88954f expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.649540:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81677200/0xcf8485587b889556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88954f expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.649549:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81677200, rc 0) 00000100:00100000:1.0:1789683350.649633:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850119296:12345-0@lo:101: Request processed in 182us (6673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683350.649640:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789683350.653172:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850119296:0@lo:101: 00010000:00010000:2.0:1789683350.653202:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f81390e00/0xcf8485587b88954f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889556 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683350.653216:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f81390e00/0xcf8485587b88954f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889556 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683350.653303:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83761c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850119424:0@lo:501: 00000100:00100000:2.0:1789683350.653366:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.653878:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc14f1540 going to sleep for 11 seconds 00000100:00100000:0.0:1789683350.661622:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850119424 00000100:00100000:0.0:1789683350.661640:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850119424 00000100:00100000:2.0:1789683350.662406:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789683350.662416:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc2073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850119424:12345-0@lo:501: 00000100:00100000:2.0:1789683350.662587:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc2073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850119424:12345-0@lo:501: Request processed in 173us (9221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.662595:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789683350.662650:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83761c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850119424:0@lo:501: 00000100:00100000:2.0:1789683350.662693:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83761c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850119552:0@lo:503: 00000100:00100000:2.0:1789683350.662736:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.662762:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc14f1540 going to sleep for 11 seconds 00000100:00100000:2.0:1789683350.662779:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850119552 00000100:00100000:2.0:1789683350.662798:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850119552 00000100:00100000:2.0:1789683350.662824:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789683350.662830:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc2071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850119552:12345-0@lo:503: 00000100:00100000:2.0:1789683350.662897:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc2071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850119552:12345-0@lo:503: Request processed in 67us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.662904:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789683350.662929:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83761c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850119552:0@lo:503: 00000100:00100000:2.0:1789683350.668203:0:9849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83761c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9849:1876618850119680:0@lo:502: 00000100:00100000:2.0:1789683350.668288:0:9849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.668335:0:9849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc14f1840 going to sleep for 11 seconds 00000100:00100000:3.0:1789683350.668380:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850119680 00000100:00100000:3.0:1789683350.668387:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850119680 00000100:00100000:3.0:1789683350.668433:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789683350.668460:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:9849:x1876618850119680:12345-0@lo:502: 00000100:00100000:3.0:1789683350.668591:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:9849:x1876618850119680:12345-0@lo:502: Request processed in 132us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683350.668599:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789683350.669091:0:9849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83761c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9849:1876618850119680:0@lo:502: 00000100:00100000:2.0:1789683350.669145:0:9849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83761c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9849:1876618850119808:0@lo:502: 00000100:00100000:2.0:1789683350.669182:0:9849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.669195:0:9849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc14f1840 going to sleep for 11 seconds 00000100:00100000:3.0:1789683350.669267:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850119808 00000100:00100000:3.0:1789683350.669272:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850119808 00000100:00100000:3.0:1789683350.669304:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789683350.669311:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:9849:x1876618850119808:12345-0@lo:502: 00000100:00100000:3.0:1789683350.669380:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:9849:x1876618850119808:12345-0@lo:502: Request processed in 69us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683350.669387:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789683350.669457:0:9849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83761c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9849:1876618850119808:0@lo:502: 00000040:00080000:2.0:1789683350.669475:0:9849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789683350.676543:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789683350.676589:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789683350.676605:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81390e00/0xcf8485587b88954f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889556 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683350.676619:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f81390e00/0xcf8485587b88954f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889556 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683350.676630:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789683350.676633:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0f88c59000 from 6 10000000:01000000:3.0:1789683350.676636:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789683350.676677:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1600/0xcf8485587b88955d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683350.676686:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1600/0xcf8485587b88955d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683350.676697:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1600/0xcf8485587b88955d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683350.676741:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850119936:0@lo:101: 00000100:00100000:3.0:1789683350.676840:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683350.676883:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789683350.676978:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850119936 00000100:00100000:1.0:1789683350.676986:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850119936 00000100:00100000:1.0:1789683350.677073:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789683350.677084:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850119936:12345-0@lo:101: 00010000:00010000:1.0:1789683350.677100:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683350.677117:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81677600/0xcf8485587b889564 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88955d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.677142:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81677600/0xcf8485587b889564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88955d expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.677154:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81677600/0xcf8485587b889564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88955d expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.677162:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81677600, rc 0) 00000100:00100000:1.0:1789683350.677212:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+19:6518:x1876618850119936:12345-0@lo:101: Request processed in 130us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683350.677219:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789683350.678668:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850119936:0@lo:101: 00010000:00010000:3.0:1789683350.678692:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1600/0xcf8485587b88955d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889564 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683350.678703:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1600/0xcf8485587b88955d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889564 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683350.678777:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850120064:0@lo:256: 00000100:00100000:3.0:1789683350.678861:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683350.678893:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683350.678913:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850120064 00000100:00100000:3.0:1789683350.678919:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850120064 00000100:00100000:3.0:1789683350.678953:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789683350.678961:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+19:6518:x1876618850120064:12345-0@lo:256: 20000000:01000000:3.0:1789683350.678982:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789683350.678999:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789683350.679002:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789683350.679081:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+19:6518:x1876618850120064:12345-0@lo:256: Request processed in 121us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683350.679090:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789683350.679123:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850120064:0@lo:256: 10000000:01000000:3.0:1789683350.679164:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789683350.679171:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1600/0xcf8485587b88955d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889564 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683350.679185:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1600/0xcf8485587b88955d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889564 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683350.679193:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789683350.679195:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1789683350.679197:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789683350.679219:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b88956b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683350.679226:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b88956b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683350.679235:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b88956b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683350.679247:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850120192:0@lo:101: 00000100:00100000:3.0:1789683350.679272:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683350.679286:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683350.679298:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850120192 00000100:00100000:3.0:1789683350.679302:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850120192 00000100:00100000:3.0:1789683350.679318:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789683350.679324:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+19:6518:x1876618850120192:12345-0@lo:101: 00010000:00010000:3.0:1789683350.679332:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683350.679344:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f829e1000/0xcf8485587b889572 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88956b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683350.679361:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f829e1000/0xcf8485587b889572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88956b expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683350.679383:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f829e1000/0xcf8485587b889572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88956b expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683350.679392:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e1000, rc 0) 00000100:00100000:3.0:1789683350.679422:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850120192:12345-0@lo:101: Request processed in 97us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683350.679427:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789683350.679463:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850120192:0@lo:101: 00010000:00010000:3.0:1789683350.679474:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b88956b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889572 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683350.679482:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b88956b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889572 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683350.679531:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850120320:0@lo:501: 00000100:00100000:3.0:1789683350.679554:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683350.679568:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683350.679579:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850120320 00000100:00100000:3.0:1789683350.679583:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850120320 00000100:00100000:3.0:1789683350.679598:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789683350.679604:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850120320:12345-0@lo:501: 00000100:00100000:3.0:1789683350.679724:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850120320:12345-0@lo:501: Request processed in 119us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683350.679731:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789683350.679758:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850120320:0@lo:501: 00000100:00100000:3.0:1789683350.679805:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850120448:0@lo:503: 00000100:00100000:3.0:1789683350.679864:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683350.679878:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683350.679891:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850120448 00000100:00100000:3.0:1789683350.679895:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850120448 00000100:00100000:3.0:1789683350.679913:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789683350.679919:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850120448:12345-0@lo:503: 00000100:00100000:3.0:1789683350.679988:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850120448:12345-0@lo:503: Request processed in 69us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683350.679995:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789683350.680028:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850120448:0@lo:503: 00000100:00100000:3.0:1789683350.680195:0:9851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9851:1876618850120576:0@lo:502: 00000100:00100000:3.0:1789683350.680228:0:9851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683350.680248:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850120576 00000100:00100000:3.0:1789683350.680251:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850120576 00000100:00100000:3.0:1789683350.680268:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789683350.680273:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:9851:x1876618850120576:12345-0@lo:502: 00000100:00100000:3.0:1789683350.680350:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:9851:x1876618850120576:12345-0@lo:502: Request processed in 76us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683350.680357:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789683350.680384:0:9851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720180 going to sleep for 11 seconds 00000100:00100000:3.0:1789683350.680396:0:9851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9851:1876618850120576:0@lo:502: 00000020:01000000:3.0:1789683350.680416:0:9851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789683350.680424:0:9851:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789683350.680430:0:9851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683350.680433:0:9851:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789683350.680438:0:9851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789683350.680446:0:9851:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:3.0:1789683350.680468:0:9851:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789683350.680471:0:9851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789683350.680493:0:9851:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9f0e837ab380) 00000020:00000080:3.0:1789683350.680515:0:9851:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1789683350.680521:0:9851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789683350.680598:0:9851:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789683350.680605:0:9851:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789683350.680613:0:9851:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf8485587b889580 00010000:00080000:3.0:1789683350.680645:0:9851:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0fc1205000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:3.0:1789683350.680915:0:9851:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1789683350.681040:0:9851:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789683350.681053:0:9851:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789683350.681221:0:9851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683350.681335:0:9851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683350.681465:0:9851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789683350.681556:0:9851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789683350.683321:0:9852:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789683350.683327:0:9852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789683350.684040:0:9851:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789683350.684053:0:9851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789683350.684094:0:9851:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789683350.684121:0:9851:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b889587 00000100:00080000:0.0:1789683350.684133:0:9851:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789683350.684146:0:9851:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0fc1205000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789683350.684189:0:9851:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc14ac000 x1876618850120704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789683350.684218:0:9851:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789683350.684284:0:9851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683350.684288:0:9851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683350.684290:0:9851:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789683350.684293:0:9851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683350.684297:0:9851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683350.684299:0:9851:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789683350.684302:0:9851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789683350.684304:0:9851:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789683350.684331:0:9851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9851:1876618850120832:0@lo:502: 00000100:00100000:0.0:1789683350.684413:0:9851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683350.684449:0:9851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8bb9cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683350.684551:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850120704:0@lo:8: 00000100:00100000:1.0:1789683350.684588:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683350.684662:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850120704 00000100:00100000:0.0:1789683350.684670:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850120704 00000100:00100000:0.0:1789683350.684874:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789683350.684884:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1876618850120704:12345-0@lo:8: 00010000:00080000:0.0:1789683350.684910:0:8439:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:0.0:1789683350.684933:0:8439:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b88958e 00002000:00100000:0.0:1789683350.684948:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9f0fb635b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789683350.684952:0:8439:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1789683350.684956:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789683350.685016:0:8439:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789683350.685223:0:8439:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789683350.685247:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9f0fb635d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683350.685309:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1876618850120704:12345-0@lo:8: Request processed in 424us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683350.685317:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789683350.685383:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc14ac000 x1876618850120704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789683360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683350.685395:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789683350.685402:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789683350.685417:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789683350.685422:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789683350.685425:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc1205000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789683350.685453:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789683350.685459:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850120704:0@lo:8: 00000004:00080000:2.0:1789683350.685483:0:9852:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789683350.685533:0:9852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 264734748842ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789683350.685539:0:9852:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789683350.691483:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850120832 00000100:00100000:3.0:1789683350.691503:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850120832 00000100:00100000:3.0:1789683350.691571:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789683350.691585:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:9851:x1876618850120832:12345-0@lo:502: 00000100:00100000:3.0:1789683350.691867:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:9851:x1876618850120832:12345-0@lo:502: Request processed in 284us (7452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683350.691876:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789683350.692879:0:9853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9853:1876618850120960:0@lo:700: 00000100:00100000:1.0:1789683350.692925:0:9853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683350.692957:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850120960 00000100:00100000:1.0:1789683350.692962:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850120960 00000100:00100000:1.0:1789683350.693003:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789683350.693010:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9853:x1876618850120960:12345-0@lo:700: 00000100:00100000:1.0:1789683350.693038:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8447:1876618850121088:0@lo:700: 00000100:00100000:1.0:1789683350.693064:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683350.693081:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49e40 going to sleep for 11 seconds 00000100:00080000:1.0:1789683350.693094:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683350.693106:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850121088 00000100:00100000:1.0:1789683350.693109:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850121088 00000100:00100000:1.0:1789683350.693134:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789683350.693140:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8447:x1876618850121088:12345-0@lo:700: 00000100:00100000:1.0:1789683350.693232:0:9853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683350.694096:0:9851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9851:1876618850120832:0@lo:502: 00000020:01000000:3.0:1789683350.694315:0:9851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683350.694325:0:9851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683350.694327:0:9851:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789683350.694333:0:9851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 40000000:02000000:1.0:1789683350.702154:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00010000:00080000:3.0:1789683350.705981:0:8447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7245880 x1876618850121088/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789683366 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683350.706017:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8447:1876618850121088:0@lo:700: 40000000:02000000:3.0:1789683350.706031:0:8447:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000004:00080000:2.0:1789683350.708188:0:7455:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000020:01000000:0.0:1789683350.708372:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1789683350.708409:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789683350.708422:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b88956b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889572 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683350.708444:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b88956b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889572 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683350.712317:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8447:x1876618850121088:12345-0@lo:700: Request processed in 19167us (19242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683350.712335:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:01000000:3.0:1789683350.716438:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789683350.716446:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0f8bdba800 from 39 10000000:01000000:3.0:1789683350.716452:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789683350.716499:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889595 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683350.716511:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889595 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683350.716523:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889595 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683350.716549:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850121216:0@lo:101: 00000100:00100000:3.0:1789683350.716613:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683350.716648:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850121216 00000100:00100000:3.0:1789683350.716655:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850121216 00000100:00100000:3.0:1789683350.716699:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789683350.716708:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850121216:12345-0@lo:101: 00010000:00010000:3.0:1789683350.716721:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683350.716734:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f829e0e00/0xcf8485587b88959c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889595 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683350.716756:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f829e0e00/0xcf8485587b88959c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889595 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683350.716766:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f829e0e00/0xcf8485587b88959c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889595 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683350.716818:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e0e00, rc 0) 00000100:00100000:3.0:1789683350.716854:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850121216:12345-0@lo:101: Request processed in 146us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683350.716860:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789683350.716899:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720480 going to sleep for 11 seconds 00000100:00100000:3.0:1789683350.716919:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850121216:0@lo:101: 00010000:00010000:3.0:1789683350.716934:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889595 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88959c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683350.716943:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889595 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88959c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683350.716993:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850121344:0@lo:501: 00000100:00100000:3.0:1789683350.717018:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683350.717042:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720480 going to sleep for 11 seconds 00000100:00100000:2.0:1789683350.717151:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850121344 00000100:00100000:2.0:1789683350.717157:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850121344 00000100:00100000:2.0:1789683350.717190:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789683350.717196:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850121344:12345-0@lo:501: 00000100:00100000:2.0:1789683350.717318:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850121344:12345-0@lo:501: Request processed in 122us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.717325:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789683350.721761:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850121344:0@lo:501: 00000100:00100000:3.0:1789683350.721851:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850121472:0@lo:503: 00000100:00100000:3.0:1789683350.721920:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683350.721956:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850121472 00000100:00100000:3.0:1789683350.721962:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850121472 00000100:00100000:3.0:1789683350.722007:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789683350.722017:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850121472:12345-0@lo:503: 00000100:00100000:3.0:1789683350.722125:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850121472:12345-0@lo:503: Request processed in 109us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683350.722133:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789683350.722182:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720480 going to sleep for 11 seconds 00000100:00100000:3.0:1789683350.722193:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850121472:0@lo:503: 00000001:00100000:0.0:1789683350.722692:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789683350.722932:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9853:x1876618850120960:12345-0@lo:700: Request processed in 29920us (30004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683350.722943:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789683350.723026:0:9853:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7244380 x1876618850120960/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789683366 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683350.723038:0:9853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9853:1876618850120960:0@lo:700: 00000100:00100000:3.0:1789683350.723251:0:9856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9856:1876618850121600:0@lo:502: 00000100:00100000:3.0:1789683350.723365:0:9856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683350.723400:0:9856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683350.723504:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850121600 00000100:00100000:0.0:1789683350.723509:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850121600 00000100:00100000:0.0:1789683350.723548:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789683350.723555:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:9856:x1876618850121600:12345-0@lo:502: 00000100:00100000:0.0:1789683350.723661:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:9856:x1876618850121600:12345-0@lo:502: Request processed in 106us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683350.723668:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789683350.723767:0:9856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9856:1876618850121600:0@lo:502: 00000100:00100000:1.0:1789683350.723847:0:9856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9856:1876618850121728:0@lo:502: 00000100:00100000:1.0:1789683350.723881:0:9856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683350.723902:0:9856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683350.723999:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850121728 00000100:00100000:3.0:1789683350.724003:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850121728 00000100:00100000:3.0:1789683350.724028:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789683350.724035:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:9856:x1876618850121728:12345-0@lo:502: 00000100:00100000:3.0:1789683350.724098:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:9856:x1876618850121728:12345-0@lo:502: Request processed in 63us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683350.724104:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789683350.724346:0:9856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9856:1876618850121728:0@lo:502: 00000040:00080000:1.0:1789683350.724364:0:9856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789683350.729897:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789683350.729941:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789683350.729953:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889595 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88959c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683350.729966:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88959c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683350.730010:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789683350.730014:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0f8bdba800 from 6 10000000:01000000:2.0:1789683350.730018:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789683350.730068:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b8895a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683350.730076:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b8895a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683350.730087:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b8895a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683350.730110:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83761c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850121856:0@lo:101: 00000100:00100000:2.0:1789683350.730340:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.730390:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc14f1840 going to sleep for 11 seconds 00000100:00100000:0.0:1789683350.733243:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850121856 00000100:00100000:0.0:1789683350.733257:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850121856 00000100:00100000:0.0:1789683350.733328:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789683350.733338:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850121856:12345-0@lo:101: 00010000:00010000:0.0:1789683350.733360:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683350.733377:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81390c00/0xcf8485587b8895aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8895a3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683350.733406:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81390c00/0xcf8485587b8895aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8895a3 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683350.733418:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81390c00/0xcf8485587b8895aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8895a3 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683350.733428:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81390c00, rc 0) 00000100:00100000:0.0:1789683350.733517:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850121856:12345-0@lo:101: Request processed in 181us (3177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683350.733524:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789683350.733582:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83761c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850121856:0@lo:101: 00010000:00010000:0.0:1789683350.733600:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b8895a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8895aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683350.733610:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b8895a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8895aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683350.733669:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850121984:0@lo:256: 00000100:00100000:0.0:1789683350.733705:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683350.733730:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850121984 00000100:00100000:0.0:1789683350.733734:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850121984 00000100:00100000:0.0:1789683350.733757:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789683350.733762:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850121984:12345-0@lo:256: 20000000:01000000:0.0:1789683350.733776:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789683350.733832:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789683350.733836:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789683350.733901:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850121984:12345-0@lo:256: Request processed in 138us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683350.733908:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789683350.733939:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8bb9ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683350.733950:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850121984:0@lo:256: 10000000:01000000:0.0:1789683350.733988:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789683350.733995:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b8895a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8895aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683350.734004:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b8895a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8895aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683350.734012:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789683350.734015:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789683350.734019:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789683350.734036:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b8895b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683350.734043:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b8895b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683350.734050:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b8895b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683350.734060:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850122112:0@lo:101: 00000100:00100000:0.0:1789683350.734082:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683350.734099:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850122112 00000100:00100000:0.0:1789683350.734102:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850122112 00000100:00100000:0.0:1789683350.734127:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789683350.734132:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850122112:12345-0@lo:101: 00010000:00010000:0.0:1789683350.734140:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683350.734149:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f80031200/0xcf8485587b8895b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8895b1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683350.734163:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f80031200/0xcf8485587b8895b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8895b1 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683350.734170:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f80031200/0xcf8485587b8895b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8895b1 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683350.734177:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f80031200, rc 0) 00000100:00100000:0.0:1789683350.734200:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850122112:12345-0@lo:101: Request processed in 67us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683350.734205:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789683350.734224:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8bb9ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683350.734234:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850122112:0@lo:101: 00010000:00010000:0.0:1789683350.734243:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b8895b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8895b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683350.734251:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b8895b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8895b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683350.734302:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850122240:0@lo:501: 00000100:00100000:0.0:1789683350.734325:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683350.734343:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8bb9ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683350.734360:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850122240 00000100:00100000:2.0:1789683350.734364:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850122240 00000100:00100000:2.0:1789683350.734396:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789683350.734402:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850122240:12345-0@lo:501: 00000100:00100000:2.0:1789683350.734571:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850122240:12345-0@lo:501: Request processed in 169us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.734578:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789683350.735233:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850122240:0@lo:501: 00000100:00100000:0.0:1789683350.735338:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850122368:0@lo:503: 00000100:00100000:0.0:1789683350.735378:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683350.735675:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8bb9ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683350.736645:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850122496:0@lo:13: 00000100:00100000:3.0:1789683350.736695:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789683350.736732:0:9853:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789683350.736751:0:9853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9853:1876618850122624:0@lo:7: 00000100:00100000:3.0:1789683350.736777:0:9853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683350.736830:0:9853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e837200c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683350.739550:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850122496 00000100:00100000:2.0:1789683350.739568:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850122496 00000100:00100000:2.0:1789683350.739631:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789683350.739642:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850122496:12345-0@lo:13: 00002000:00000024:2.0:1789683350.739674:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1789683350.739849:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850122496:12345-0@lo:13: Request processed in 208us (3152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.739856:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789683350.739881:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850122624 00000100:00100000:2.0:1789683350.739885:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850122624 00000100:00100000:2.0:1789683350.739907:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789683350.739913:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9853:x1876618850122624:12345-0@lo:7: 00010000:00080000:3.0:1789683350.740878:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7962300 x1876618850122496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683350.740901:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850122496:0@lo:13: 00000100:00100000:1.0:1789683350.741002:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850122368 00000100:00100000:1.0:1789683350.741009:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850122368 00000100:00100000:1.0:1789683350.741045:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789683350.741053:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850122368:12345-0@lo:503: 00000100:00100000:1.0:1789683350.741172:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850122368:12345-0@lo:503: Request processed in 119us (5792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683350.741179:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789683350.741235:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850122368:0@lo:503: 00000100:00100000:1.0:1789683350.743031:0:9859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9859:1876618850122752:0@lo:502: 00000100:00100000:1.0:1789683350.743102:0:9859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683350.743148:0:9859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49780 going to sleep for 11 seconds 00000100:00100000:0.0:1789683350.744454:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850122752 00000100:00100000:0.0:1789683350.744465:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850122752 00000100:00100000:0.0:1789683350.744521:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789683350.744532:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:9859:x1876618850122752:12345-0@lo:502: 00000100:00100000:0.0:1789683350.744685:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:9859:x1876618850122752:12345-0@lo:502: Request processed in 153us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683350.744693:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00002000:00080000:2.0:1789683350.744972:0:8676:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789683350.744979:0:8676:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789683350.745026:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9853:x1876618850122624:12345-0@lo:7: Request processed in 5112us (8247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.745034:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789683350.745425:0:9859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9859:1876618850122752:0@lo:502: 00000020:01000000:1.0:1789683350.745461:0:9859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789683350.745468:0:9859:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789683350.745476:0:9859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683350.745478:0:9859:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789683350.745483:0:9859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789683350.745487:0:9859:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:1.0:1789683350.745517:0:9859:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789683350.745520:0:9859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789683350.745547:0:9859:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9f0e83c2cd40) 00000020:00000080:1.0:1789683350.745569:0:9859:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1789683350.745575:0:9859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789683350.745652:0:9859:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789683350.745656:0:9859:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789683350.745661:0:9859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b8895c6 00010000:00080000:1.0:1789683350.745683:0:9859:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0e83c36000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00080000:2.0:1789683350.745857:0:9853:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7960700 x1876618850122624/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789683366 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683350.745881:0:9853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9853:1876618850122624:0@lo:7: 00000004:00080000:2.0:1789683350.745891:0:9853:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00010000:00010000:1.0:1789683350.745915:0:9859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000100:00100000:2.0:1789683350.745925:0:9853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83763800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9853:1876618850122880:0@lo:5: 00000100:00100000:2.0:1789683350.745961:0:9853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.745992:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850122880 00000100:00100000:2.0:1789683350.745996:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850122880 00000100:00100000:2.0:1789683350.746027:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000040:01000000:1.0:1789683350.746032:0:9859:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1789683350.746034:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9853:x1876618850122880:12345-0@lo:5: 00000040:01000000:1.0:1789683350.746044:0:9859:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00002000:00080000:2.0:1789683350.746057:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1789683350.746085:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9853:x1876618850122880:12345-0@lo:5: Request processed in 51us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.746091:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789683350.746111:0:9853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510e9c0 going to sleep for 11 seconds 00010000:00080000:2.0:1789683350.746138:0:9853:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83763800 x1876618850122880/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683366 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683350.746147:0:9853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83763800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9853:1876618850122880:0@lo:5: 00000004:00080000:2.0:1789683350.746155:0:9853:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789683350.746176:0:9853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83763800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9853:1876618850123008:0@lo:5: 00000100:00100000:2.0:1789683350.746197:0:9853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789683350.746198:0:9859:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789683350.746219:0:9853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510e9c0 going to sleep for 11 seconds 00000040:00080000:1.0:1789683350.746329:0:9859:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683350.746448:0:9859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789683350.746504:0:9859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:3.0:1789683350.747178:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850123008 00000100:00100000:3.0:1789683350.747186:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850123008 00000100:00100000:3.0:1789683350.747229:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683350.747237:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9853:x1876618850123008:12345-0@lo:5: 00002000:00080000:3.0:1789683350.747356:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000040:00080000:1.0:1789683350.747975:0:9860:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683350.747980:0:9860:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789683350.748825:0:9859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789683350.748836:0:9859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789683350.748872:0:9859:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789683350.748898:0:9859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b8895cd 00000100:00080000:1.0:1789683350.748908:0:9859:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789683350.748919:0:9859:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0e83c36000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683350.748952:0:9859:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7244380 x1876618850123136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683350.748977:0:9859:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789683350.749023:0:9859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683350.749027:0:9859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683350.749029:0:9859:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789683350.749032:0:9859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683350.749036:0:9859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683350.749037:0:9859:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789683350.749046:0:9859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789683350.749048:0:9859:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789683350.749075:0:9859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9859:1876618850123264:0@lo:502: 00000100:00100000:1.0:1789683350.749144:0:9859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683350.750550:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850123136:0@lo:8: 00000100:00100000:0.0:1789683350.750596:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.750636:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850123136 00000100:00100000:2.0:1789683350.750644:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850123136 00000100:00100000:2.0:1789683350.750679:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789683350.750686:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1876618850123136:12345-0@lo:8: 00010000:00080000:2.0:1789683350.750725:0:8437:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:2.0:1789683350.750757:0:8437:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b8895d4 00002000:00100000:2.0:1789683350.750771:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9f0e83446000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789683350.750775:0:8437:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789683350.750778:0:8437:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789683350.750870:0:8437:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789683350.750894:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9f0e83440800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789683350.750946:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876618850123136:12345-0@lo:8: Request processed in 259us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.750953:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789683350.750996:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7244380 x1876618850123136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789683360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683350.751008:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789683350.751016:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789683350.751024:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789683350.751028:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789683350.751031:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83c36000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789683350.751045:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789683350.751050:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850123136:0@lo:8: 00000004:00080000:2.0:1789683350.751130:0:9860:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789683350.751175:0:9860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 264800390024ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789683350.751180:0:9860:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789683350.751395:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850123264 00000100:00100000:1.0:1789683350.751401:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850123264 00000100:00100000:1.0:1789683350.751432:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789683350.751525:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:9859:x1876618850123264:12345-0@lo:502: 00000100:00100000:1.0:1789683350.751613:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:9859:x1876618850123264:12345-0@lo:502: Request processed in 175us (2469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683350.751617:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789683350.751651:0:9859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f925050c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683350.751663:0:9859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:9859:1876618850123264:0@lo:502: 00000020:01000000:1.0:1789683350.751686:0:9859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683350.751691:0:9859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683350.751693:0:9859:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789683350.751697:0:9859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1789683350.751798:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1789683350.751837:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789683350.751848:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b8895b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8895b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683350.751859:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b8895b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8895b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683350.751877:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789683350.751880:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f0fa508b380 from 1 10000000:01000000:2.0:1789683350.751882:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789683350.751911:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8895db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683350.751919:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8895db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683350.751928:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8895db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683350.751946:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83762680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850123392:0@lo:101: 00000100:00100000:2.0:1789683350.751988:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.752109:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683350.752501:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850123392 00000100:00100000:1.0:1789683350.752506:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850123392 00000100:00100000:1.0:1789683350.752535:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789683350.752542:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850123392:12345-0@lo:101: 00010000:00010000:1.0:1789683350.752552:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683350.752573:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837dba00/0xcf8485587b8895e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8895db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.752592:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837dba00/0xcf8485587b8895e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8895db expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.752600:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837dba00/0xcf8485587b8895e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8895db expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.752610:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dba00, rc 0) 00000100:00100000:1.0:1789683350.752642:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850123392:12345-0@lo:101: Request processed in 100us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683350.752648:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789683350.752664:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83762680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850123392:0@lo:101: 00010000:00010000:2.0:1789683350.752677:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8895db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8895e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683350.752686:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8895db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8895e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683350.752753:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83762680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850123520:0@lo:501: 00000100:00100000:2.0:1789683350.752780:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683350.752824:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683350.753800:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9853:x1876618850123008:12345-0@lo:5: Request processed in 6548us (7585us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789683350.753819:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789683350.753843:0:9853:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83763800 x1876618850123008/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683366 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683350.753869:0:9853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83763800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9853:1876618850123008:0@lo:5: 00000004:00080000:2.0:1789683350.753880:0:9853:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789683350.753914:0:9853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83762a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9853:1876618850123648:0@lo:900: 00000100:00100000:1.0:1789683350.754174:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850123520 00000100:00100000:1.0:1789683350.754180:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850123520 00000100:00100000:1.0:1789683350.754220:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789683350.754228:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850123520:12345-0@lo:501: 00000100:00100000:2.0:1789683350.754233:0:9853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683350.754307:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850123520:12345-0@lo:501: Request processed in 80us (1526us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789683350.754314:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789683350.754329:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850123648 00000100:00100000:2.0:1789683350.754334:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850123648 00000100:00100000:1.0:1789683350.754348:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83762680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850123520:0@lo:501: 00000100:00100000:2.0:1789683350.754362:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683350.754368:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9853:x1876618850123648:12345-0@lo:900: 10000000:01000000:1.0:1789683350.754382:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789683350.754390:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8895db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8895e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683350.754399:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8895db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8895e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683350.754400:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9853:x1876618850123648:12345-0@lo:900: Request processed in 33us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.754406:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683350.754424:0:9853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510e9c0 going to sleep for 11 seconds 00010000:00080000:2.0:1789683350.754438:0:9853:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83762a00 x1876618850123648/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789683366 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683350.754447:0:9853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83762a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9853:1876618850123648:0@lo:900: 00000004:00080000:2.0:1789683350.758149:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789683350.758425:0:9861:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789683350.758469:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850123776:0@lo:13: 00000100:00100000:2.0:1789683350.758546:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683350.758581:0:9861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9861:1876618850123904:0@lo:7: 00000100:00100000:2.0:1789683350.758596:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850123776 00000100:00100000:2.0:1789683350.758604:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850123776 00000100:00100000:3.0:1789683350.758614:0:9861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683350.758629:0:9861:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720840 going to sleep for 11 seconds 00000100:00100000:2.0:1789683350.758668:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789683350.758668:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789683350.758677:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1876618850123776:12345-0@lo:13: 00000100:00100000:1.0:1789683350.758680:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850123904 00000100:00100000:1.0:1789683350.758683:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850123904 00002000:00000024:2.0:1789683350.758699:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:1.0:1789683350.758709:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789683350.758715:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:9861:x1876618850123904:12345-0@lo:7: 00000100:00100000:2.0:1789683350.758753:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876618850123776:12345-0@lo:13: Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.758773:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789683350.758843:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7962300 x1876618850123776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683350.758860:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850123776:0@lo:13: 00002000:00080000:1.0:1789683350.768312:0:8676:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789683350.768322:0:8676:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789683350.768671:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9861:x1876618850123904:12345-0@lo:7: Request processed in 9951us (10051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683350.768683:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789683350.772627:0:9861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7960a80 x1876618850123904/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789683366 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683350.772648:0:9861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9861:1876618850123904:0@lo:7: 00000004:00080000:3.0:1789683350.772663:0:9861:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789683350.772703:0:9861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9861:1876618850124032:0@lo:5: 00000100:00100000:3.0:1789683350.772763:0:9861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683350.772924:0:9861:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720840 going to sleep for 11 seconds 00000100:00100000:0.0:1789683350.777363:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850124032 00000100:00100000:0.0:1789683350.777383:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850124032 00000100:00100000:1.0:1789683350.779667:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789683350.779681:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9861:x1876618850124032:12345-0@lo:5: 00002000:00080000:1.0:1789683350.779719:0:8439:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789683350.779723:0:8439:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1789683350.791976:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1789683350.792001:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789683350.792008:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789683350.792264:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9861:x1876618850124032:12345-0@lo:5: Request processed in 12582us (19496us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789683350.792285:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789683350.792509:0:9861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7960a80 x1876618850124032/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683366 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683350.792522:0:9861:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789683350.792529:0:9861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9861:1876618850124032:0@lo:5: 00000004:00080000:3.0:1789683350.792543:0:9861:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789683350.792585:0:9861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9861:1876618850124160:0@lo:700: 00000100:00100000:3.0:1789683350.792618:0:9861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683350.792658:0:9861:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720840 going to sleep for 11 seconds 00000100:00100000:1.0:1789683350.792987:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850124160 00000100:00100000:1.0:1789683350.792995:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850124160 00000100:00100000:1.0:1789683350.793044:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683350.793053:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9861:x1876618850124160:12345-0@lo:700: 00000100:00100000:2.0:1789683350.815902:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9861:x1876618850124160:12345-0@lo:700: Request processed in 22841us (23273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683350.815924:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789683350.816236:0:9861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7960a80 x1876618850124160/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789683366 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683350.816250:0:9861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9861:1876618850124160:0@lo:700: 00000004:02000040:0.0:1789683350.819928:0:9861:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1789683350.827582:0:9861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9861:1876618850124288:0@lo:5: 00000100:00100000:1.0:1789683350.827663:0:9861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683350.827822:0:9861:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc0775180 going to sleep for 11 seconds 00000100:00100000:3.0:1789683350.829269:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850124288 00000100:00100000:3.0:1789683350.829281:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850124288 00000100:00100000:3.0:1789683350.829389:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789683350.829399:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9861:x1876618850124288:12345-0@lo:5: 00002000:00080000:0.0:1789683350.838396:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789683350.838420:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1789683350.840676:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9861:x1876618850124288:12345-0@lo:5: Request processed in 11272us (13006us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789683350.840690:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789683350.842086:0:9861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7245880 x1876618850124288/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683366 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683350.842107:0:9861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9861:1876618850124288:0@lo:5: 00000004:00080000:2.0:1789683350.842192:0:9861:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:02000400:0.0:1789683351.033056:0:9890:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789683351.584579:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789683352.169458:0:9942:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789683352.169710:0:9942:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789683352.610726:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789683353.106252:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1789683353.185437:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683353.185465:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850124416:0@lo:41: 00000100:00100000:3.0:1789683353.185555:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683353.185763:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850124416 00000100:00100000:2.0:1789683353.185804:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850124416 00000100:00100000:2.0:1789683353.185878:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789683353.185888:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850124416:12345-0@lo:41: 00000004:00000024:2.0:1789683353.189284:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789683353.189417:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850124416:12345-0@lo:41: Request processed in 3526us (3857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683353.189428:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789683353.189609:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850124416:0@lo:41: 00010000:00010000:2.0:1789683353.633944:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683353.701496:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683353.701524:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850124544:0@lo:13: 00000100:00100000:2.0:1789683353.701594:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683353.702079:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850124544 00000100:00100000:3.0:1789683353.702089:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850124544 00000100:00100000:3.0:1789683353.702167:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789683353.702178:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850124544:12345-0@lo:13: 00002000:00000024:3.0:1789683353.702211:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683353.702264:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850124544:12345-0@lo:13: Request processed in 87us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683353.702272:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789683353.702339:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789683353.702413:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7960a80 x1876618850124544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683353.702445:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850124544:0@lo:13: 00000100:00100000:0.0:1789683354.207009:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683354.216881:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850124800:0@lo:41: 00000100:00100000:0.0:1789683354.216979:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683354.217399:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850124800 00000100:00100000:0.0:1789683354.217414:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850124800 00000100:00100000:0.0:1789683354.217478:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789683354.217489:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850124800:12345-0@lo:41: 00000004:00000024:0.0:1789683354.217539:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789683354.217598:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850124800:12345-0@lo:41: Request processed in 110us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683354.217605:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789683354.217690:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850124800:0@lo:41: 00000100:00100000:0.0:1789683354.217700:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850124672:0@lo:13: 00000100:00100000:0.0:1789683354.217731:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683354.221670:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850124672 00000100:00100000:3.0:1789683354.221694:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850124672 00000100:00100000:3.0:1789683354.221854:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789683354.221867:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850124672:12345-0@lo:13: 00002000:00000024:3.0:1789683354.221905:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1789683354.222154:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83762300 x1876618850124672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683354.222184:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850124672:0@lo:13: 00000100:00100000:3.0:1789683354.222451:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850124672:12345-0@lo:13: Request processed in 585us (4716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683354.222461:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789683354.222887:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789683354.657118:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789683355.518261:0:10043:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789683355.518633:0:10043:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789683355.684355:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683355.746877:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850124928:0@lo:13: 00000100:00100000:0.0:1789683355.746973:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683355.747087:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850124928 00000100:00100000:0.0:1789683355.747097:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850124928 00000100:00100000:0.0:1789683355.747167:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789683355.747179:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850124928:12345-0@lo:13: 00002000:00000024:0.0:1789683355.747218:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683355.747269:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850124928:12345-0@lo:13: Request processed in 93us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683355.747277:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789683355.747302:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789683355.747335:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc14afb80 x1876618850124928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683355.747357:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789683355.747386:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850124928:0@lo:13: 00000100:00100000:0.0:1789683356.259963:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683356.259985:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850125056:0@lo:13: 00000100:00100000:0.0:1789683356.260052:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683356.260122:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850125056 00000100:00100000:0.0:1789683356.260228:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850125056 00000100:00100000:0.0:1789683356.260285:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789683356.260295:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850125056:12345-0@lo:13: 00002000:00000024:0.0:1789683356.260321:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683356.260364:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850125056:12345-0@lo:13: Request processed in 70us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683356.260370:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789683356.260389:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789683356.260417:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc14afb80 x1876618850125056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683356.260621:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789683356.260641:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850125056:0@lo:13: 00000100:00100000:0.0:1789683356.267468:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850125184:0@lo:400: 00000100:00100000:0.0:1789683356.267552:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683356.267606:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850125696:0@lo:400: 00000100:00100000:0.0:1789683356.267634:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683356.267654:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850126208:0@lo:400: 00000100:00100000:0.0:1789683356.267675:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683356.267722:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789683356.267728:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850125312:0@lo:400: 00000100:00100000:0.0:1789683356.267764:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683356.267816:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1876618850125824:0@lo:400: 00000100:00100000:0.0:1789683356.267850:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683356.267881:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850126336:0@lo:400: 00000100:00100000:0.0:1789683356.267907:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683356.267933:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850125440:0@lo:400: 00000100:00100000:0.0:1789683356.267953:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683356.267968:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850125952:0@lo:400: 00000100:00100000:0.0:1789683356.267986:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683356.268003:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850126464:0@lo:400: 00000100:00100000:0.0:1789683356.268022:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683356.268035:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789683356.268040:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850125568:0@lo:400: 00000100:00100000:0.0:1789683356.268059:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683356.268069:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850126080:0@lo:400: 00000100:00100000:0.0:1789683356.268085:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683356.268100:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850126592:0@lo:400: 00000100:00100000:0.0:1789683356.268118:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683356.268579:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850125184 00000100:00100000:3.0:1789683356.268589:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850125184 00000100:00100000:3.0:1789683356.268647:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789683356.268657:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850125184:12345-0@lo:400: 00000100:00100000:1.0:1789683356.268775:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850126208 00000100:00100000:1.0:1789683356.268780:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850126208 00000100:00100000:1.0:1789683356.268833:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850126080 00000100:00100000:1.0:1789683356.268842:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850126080 00000100:00100000:1.0:1789683356.268858:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850126592 00000100:00100000:1.0:1789683356.268861:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850126592 00000100:00100000:1.0:1789683356.268885:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789683356.268892:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850126208:12345-0@lo:400: 00000100:00100000:2.0:1789683356.269070:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850125312 00000100:00100000:2.0:1789683356.269075:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850125312 00000100:00100000:2.0:1789683356.269097:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850125824 00000100:00100000:2.0:1789683356.269100:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850125824 00000100:00100000:2.0:1789683356.269112:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850126336 00000100:00100000:2.0:1789683356.269115:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850126336 00000100:00100000:2.0:1789683356.269124:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850125952 00000100:00100000:2.0:1789683356.269139:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850125952 00000100:00100000:2.0:1789683356.269152:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850126464 00000100:00100000:2.0:1789683356.269156:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850126464 00000100:00100000:2.0:1789683356.269165:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850125568 00000100:00100000:2.0:1789683356.269168:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850125568 00000100:00100000:2.0:1789683356.269179:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789683356.269185:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850125312:12345-0@lo:400: 00000100:00100000:1.0:1789683356.269647:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850126208:12345-0@lo:400: Request processed in 754us (1969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683356.269654:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789683356.269675:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789683356.269681:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850126080:12345-0@lo:400: 00000100:00100000:1.0:1789683356.269723:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850126080:12345-0@lo:400: Request processed in 32us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683356.269737:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789683356.269749:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789683356.269755:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850126592:12345-0@lo:400: 00000100:00100000:1.0:1789683356.269803:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850126592:12345-0@lo:400: Request processed in 27us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683356.269810:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789683356.270031:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb61f2d80 x1876618850126208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683356.270046:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850126208:0@lo:400: 00010000:00080000:0.0:1789683356.271692:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f88cdd180 x1876618850126592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683356.271721:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850126592:0@lo:400: 00000100:00080000:1.0:1789683356.271837:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789683356.271844:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683356.271847:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683356.272040:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789683356.272054:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876618850125824:12345-0@lo:400: 00000100:00100000:3.0:1789683356.272317:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876618850125824:12345-0@lo:400: Request processed in 267us (4465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683356.272325:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789683356.272351:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789683356.272358:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850126336:12345-0@lo:400: 00000100:00100000:3.0:1789683356.272390:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850126336:12345-0@lo:400: Request processed in 34us (4482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683356.272395:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789683356.272408:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789683356.272414:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850125952:12345-0@lo:400: 00000100:00100000:3.0:1789683356.272456:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850125952:12345-0@lo:400: Request processed in 43us (4469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683356.272462:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789683356.272474:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789683356.272481:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850126464:12345-0@lo:400: 00000100:00100000:3.0:1789683356.272509:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850126464:12345-0@lo:400: Request processed in 30us (4487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683356.272514:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789683356.272537:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789683356.272543:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850125568:12345-0@lo:400: 00000100:00100000:3.0:1789683356.272572:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850125568:12345-0@lo:400: Request processed in 31us (4513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683356.272577:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789683356.272607:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850125696 00000100:00100000:3.0:1789683356.272614:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850125696 00000100:00100000:3.0:1789683356.272679:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850125440 00000100:00100000:3.0:1789683356.272683:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850125440 00000100:00100000:3.0:1789683356.272697:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789683356.272702:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850125696:12345-0@lo:400: 00000100:00100000:3.0:1789683356.272754:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850125696:12345-0@lo:400: Request processed in 52us (5119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683356.272760:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789683356.272773:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789683356.272779:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850125440:12345-0@lo:400: 00000100:00100000:3.0:1789683356.272850:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850125440:12345-0@lo:400: Request processed in 71us (4896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683356.272856:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1789683356.273121:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb61f1c00 x1876618850125824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683356.273144:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1876618850125824:0@lo:400: 00010000:00080000:1.0:1789683356.273157:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb61f3100 x1876618850126336/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683356.273165:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850126336:0@lo:400: 00000100:00100000:1.0:1789683356.273187:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850125696:0@lo:400: 00000100:00100000:0.0:1789683356.273450:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850125440:0@lo:400: 00010000:00080000:0.0:1789683356.273464:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb61f3800 x1876618850125952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683356.273481:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850125952:0@lo:400: 00010000:00080000:0.0:1789683356.273494:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f88cdd880 x1876618850126464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683356.273502:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850126464:0@lo:400: 00010000:00080000:0.0:1789683356.273525:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e81d40000 x1876618850125568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683356.273532:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850125568:0@lo:400: 00010000:00080000:0.0:1789683356.273543:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb61f3480 x1876618850126080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683356.273550:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850126080:0@lo:400: 00000100:00100000:0.0:1789683356.274758:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850125184:12345-0@lo:400: Request processed in 6096us (7198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683356.274771:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789683356.274852:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850125184:0@lo:400: 00000100:00100000:2.0:1789683356.275723:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850125312:12345-0@lo:400: Request processed in 6524us (7944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683356.275742:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789683356.276051:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7960700 x1876618850125312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683356.276063:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850125312:0@lo:400: 00010000:00010000:2.0:1789683356.704960:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789683356.722678:0:10092:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789683356.722690:0:10092:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1789683357.268817:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683357.269101:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835394688 00000100:00100000:3.0:1789683357.269112:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835394688 00000100:00100000:3.0:1789683357.269203:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 185 00000100:00100000:3.0:1789683357.269211:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2401:x1876618835394688:12345-192.168.201.50@tcp:250: 00010000:00080000:3.0:1789683357.269238:0:6515:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ea7031b9-febc-4826-a965-62f420153ef7@192.168.201.50@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:3.0:1789683357.269264:0:6515:0:(genops.c:1384:class_connect()) connect: client ea7031b9-febc-4826-a965-62f420153ef7, cookie 0xcf8485587b8895e9 00000100:00080000:3.0:1789683357.269403:0:6515:0:(import.c:65:import_set_state_nolock()) ffff9f0e82750000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683357.269476:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+5:2401:x1876618835394688:12345-192.168.201.50@tcp:250: Request processed in 263us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683357.269491:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 185 00000100:00100000:0.0:1789683357.272820:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683357.272912:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835394816 00000100:00100000:1.0:1789683357.272926:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835394816 00000100:00100000:1.0:1789683357.272996:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 186 00000100:00100000:1.0:1789683357.273012:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+5:6161:x1876618835394816:12345-192.168.201.50@tcp:101: 00010000:00010000:1.0:1789683357.273225:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683357.273247:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837da400/0xcf8485587b8895f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc3c3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683357.273275:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837da400/0xcf8485587b8895f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3c3 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683357.273286:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837da400/0xcf8485587b8895f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3c3 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683357.273295:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da400, rc 0) 00000100:00100000:1.0:1789683357.273401:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+6:6161:x1876618835394816:12345-192.168.201.50@tcp:101: Request processed in 391us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683357.273408:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 186 00000100:00100000:2.0:1789683357.282216:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683357.282347:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835394944 00000100:00100000:3.0:1789683357.282358:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835394944 00000100:00100000:3.0:1789683357.282415:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 187 00000100:00100000:3.0:1789683357.282425:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+6:6161:x1876618835394944:12345-192.168.201.50@tcp:501: 00000100:00100000:3.0:1789683357.282538:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+6:6161:x1876618835394944:12345-192.168.201.50@tcp:501: Request processed in 114us (333us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789683357.282546:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 187 00000100:00100000:0.0:1789683357.286008:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683357.286198:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835395072 00000100:00100000:1.0:1789683357.286208:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835395072 00000100:00100000:1.0:1789683357.286273:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 188 00000100:00100000:1.0:1789683357.286285:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+6:6161:x1876618835395072:12345-192.168.201.50@tcp:101: 00010000:00010000:1.0:1789683357.286304:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683357.286321:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837da800/0xcf8485587b8895f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc3ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683357.286364:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837da800/0xcf8485587b8895f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3ca expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683357.286382:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837da800/0xcf8485587b8895f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3ca expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683357.286393:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da800, rc 0) 00000100:00100000:1.0:1789683357.286462:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+7:6161:x1876618835395072:12345-192.168.201.50@tcp:101: Request processed in 178us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683357.286469:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 188 00000100:00100000:0.0:1789683357.292246:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683357.292389:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835395200 00000100:00100000:2.0:1789683357.292400:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835395200 00000100:00100000:2.0:1789683357.292559:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 189 00000100:00100000:2.0:1789683357.292570:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+7:6161:x1876618835395200:12345-192.168.201.50@tcp:501: 00000100:00100000:2.0:1789683357.292760:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+8:6161:x1876618835395200:12345-192.168.201.50@tcp:501: Request processed in 192us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683357.292818:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 189 00000100:00100000:3.0:1789683357.294840:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683357.295686:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835395328 00000100:00100000:1.0:1789683357.295706:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835395328 00000100:00100000:1.0:1789683357.295754:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 190 00000100:00100000:1.0:1789683357.295763:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+8:6161:x1876618835395328:12345-192.168.201.50@tcp:503: 00000100:00100000:1.0:1789683357.295989:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+8:6161:x1876618835395328:12345-192.168.201.50@tcp:503: Request processed in 226us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683357.295997:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 190 00000100:00100000:0.0:1789683357.304665:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683357.304837:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835395456 00000100:00100000:1.0:1789683357.304848:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835395456 00000100:00100000:1.0:1789683357.304951:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 191 00000100:00100000:1.0:1789683357.304963:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+8:6180:x1876618835395456:12345-192.168.201.50@tcp:502: 00000100:00100000:1.0:1789683357.305162:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+8:6180:x1876618835395456:12345-192.168.201.50@tcp:502: Request processed in 192us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683357.305171:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 191 00000100:00100000:2.0:1789683357.358586:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683357.358730:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835395584 00000100:00100000:0.0:1789683357.358741:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835395584 00000100:00100000:0.0:1789683357.358839:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 192 00000100:00100000:0.0:1789683357.358851:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+8:6180:x1876618835395584:12345-192.168.201.50@tcp:502: 00000100:00100000:0.0:1789683357.359044:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+8:6180:x1876618835395584:12345-192.168.201.50@tcp:502: Request processed in 194us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683357.359052:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 192 00000100:00100000:3.0:1789683357.362593:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683357.363875:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835395712 00000100:00100000:1.0:1789683357.363902:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835395712 00000100:00100000:1.0:1789683357.364126:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 193 00000100:00100000:1.0:1789683357.364139:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+8:6161:x1876618835395712:12345-192.168.201.50@tcp:101: 00010000:00010000:1.0:1789683357.364168:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683357.364188:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837da000/0xcf8485587b8895fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc3fb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683357.364220:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837da000/0xcf8485587b8895fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3fb expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683357.364232:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837da000/0xcf8485587b8895fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3fb expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683357.364242:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da000, rc 0) 00000100:00100000:1.0:1789683357.364322:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+9:6161:x1876618835395712:12345-192.168.201.50@tcp:101: Request processed in 178us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683357.364330:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 193 00000100:00100000:3.0:1789683357.369030:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683357.370128:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835395840 00000100:00100000:0.0:1789683357.370142:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835395840 00000100:00100000:0.0:1789683357.370203:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 194 00000100:00100000:0.0:1789683357.370216:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+9:6161:x1876618835395840:12345-192.168.201.50@tcp:256: 20000000:01000000:0.0:1789683357.370245:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789683357.370271:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789683357.370276:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789683357.370279:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789683357.370282:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789683357.370284:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1789683357.372728:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+9:6161:x1876618835395840:12345-192.168.201.50@tcp:256: Request processed in 2504us (3699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683357.372745:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 194 00000100:00100000:3.0:1789683357.375593:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683357.375714:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835395968 00000100:00100000:0.0:1789683357.375724:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835395968 00000100:00100000:0.0:1789683357.375771:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 195 00000100:00100000:0.0:1789683357.375812:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+9:6161:x1876618835395968:12345-192.168.201.50@tcp:101: 00010000:00010000:0.0:1789683357.375830:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683357.375849:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f80031400/0xcf8485587b889605 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc402 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683357.375877:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f80031400/0xcf8485587b889605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc402 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683357.375907:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f80031400/0xcf8485587b889605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc402 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683357.375916:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f80031400, rc 0) 00000100:00100000:0.0:1789683357.375969:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+10:6161:x1876618835395968:12345-192.168.201.50@tcp:101: Request processed in 189us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683357.375976:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 195 00000100:00100000:0.0:1789683357.378663:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683357.378821:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835396096 00000100:00100000:3.0:1789683357.378830:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835396096 00000100:00100000:3.0:1789683357.378891:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 196 00000100:00100000:3.0:1789683357.378901:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+10:6161:x1876618835396096:12345-192.168.201.50@tcp:501: 00000100:00100000:3.0:1789683357.379061:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+10:6161:x1876618835396096:12345-192.168.201.50@tcp:501: Request processed in 161us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683357.379068:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 196 00000100:00100000:3.0:1789683357.381332:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683357.381434:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835396224 00000100:00100000:0.0:1789683357.381444:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835396224 00000100:00100000:0.0:1789683357.381511:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 197 00000100:00100000:0.0:1789683357.381521:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+10:6161:x1876618835396224:12345-192.168.201.50@tcp:503: 00000100:00100000:0.0:1789683357.381679:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+10:6161:x1876618835396224:12345-192.168.201.50@tcp:503: Request processed in 160us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683357.381688:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 197 00000100:00100000:0.0:1789683357.385004:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683357.385097:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835396352 00000100:00100000:3.0:1789683357.385110:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835396352 00000100:00100000:3.0:1789683357.385178:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 198 00000100:00100000:3.0:1789683357.385204:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+10:6186:x1876618835396352:12345-192.168.201.50@tcp:502: 00000100:00100000:3.0:1789683357.385392:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+10:6186:x1876618835396352:12345-192.168.201.50@tcp:502: Request processed in 190us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683357.385400:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 198 00000100:00100000:3.0:1789683357.390208:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683357.390308:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835396480 00000100:00100000:1.0:1789683357.390317:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835396480 00000100:00100000:1.0:1789683357.390365:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 199 00000100:00100000:1.0:1789683357.390375:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+10:6186:x1876618835396480:12345-192.168.201.50@tcp:502: 00000100:00100000:1.0:1789683357.390531:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+10:6186:x1876618835396480:12345-192.168.201.50@tcp:502: Request processed in 157us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683357.390539:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 199 00000100:00100000:0.0:1789683357.394837:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683357.394882:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683357.394969:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835396608 00000100:00100000:3.0:1789683357.394980:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835396608 00000100:00100000:3.0:1789683357.395036:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835396864 00000100:00100000:3.0:1789683357.395040:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835396864 00000100:00100000:3.0:1789683357.395062:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:3.0:1789683357.395071:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1876618835396608:12345-192.168.201.50@tcp:38: 00010000:00080000:3.0:1789683357.395103:0:6521:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:3.0:1789683357.395187:0:6521:0:(genops.c:1384:class_connect()) connect: client ec036ece-1720-411a-849c-c978dbb41f8a, cookie 0xcf8485587b88960c 00000004:00100000:3.0:1789683357.395216:0:6521:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1789683357.395462:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9f0fb613a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683357.395528:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+6:2401:x1876618835396608:12345-192.168.201.50@tcp:38: Request processed in 457us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683357.395535:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:3.0:1789683357.395554:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:3.0:1789683357.395559:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1876618835396864:12345-192.168.201.50@tcp:38: 00010000:00080000:3.0:1789683357.395573:0:6521:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:3.0:1789683357.395612:0:6521:0:(genops.c:1384:class_connect()) connect: client ec036ece-1720-411a-849c-c978dbb41f8a, cookie 0xcf8485587b889613 00000004:00100000:3.0:1789683357.395625:0:6521:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:3.0:1789683357.395778:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9f0fc148a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683357.395837:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+6:2401:x1876618835396864:12345-192.168.201.50@tcp:38: Request processed in 276us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683357.395851:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 8 00010000:00010000:2.0:1789683357.726940:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683358.152171:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683358.152255:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683358.152576:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683358.152594:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835397120 00000100:00100000:3.0:1789683358.152604:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835397120 00000100:00080000:2.0:1789683358.152810:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683358.153123:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835396992 00000100:00100000:1.0:1789683358.153129:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835396992 00000100:00100000:1.0:1789683358.153230:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835396736 00000100:00100000:1.0:1789683358.153234:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835396736 00000100:00100000:1.0:1789683358.153268:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:1.0:1789683358.153277:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:6161:x1876618835397120:12345-192.168.201.50@tcp:41: 00000004:00000024:1.0:1789683358.153320:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789683358.153408:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:6161:x1876618835397120:12345-192.168.201.50@tcp:41: Request processed in 131us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683358.153415:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:1.0:1789683358.153434:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:1.0:1789683358.153441:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:0:x1876618835396992:12345-192.168.201.50@tcp:41: 00000004:00000024:1.0:1789683358.153457:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789683358.153480:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:0:x1876618835396992:12345-192.168.201.50@tcp:41: Request processed in 40us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683358.153485:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:1.0:1789683358.153499:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:1.0:1789683358.153505:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:0:x1876618835396736:12345-192.168.201.50@tcp:41: 00000004:00000024:1.0:1789683358.153516:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789683358.153536:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:0:x1876618835396736:12345-192.168.201.50@tcp:41: Request processed in 32us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683358.153542:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00080000:1.0:1789683358.153556:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683358.156878:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683358.156981:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835397248 00000100:00100000:1.0:1789683358.156994:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835397248 00000100:00100000:1.0:1789683358.157052:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:1.0:1789683358.157062:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:6161:x1876618835397248:12345-192.168.201.50@tcp:40: 00000100:00100000:1.0:1789683358.157157:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:6161:x1876618835397248:12345-192.168.201.50@tcp:40: Request processed in 97us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683358.157183:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:1.0:1789683358.160991:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683358.161089:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683358.161254:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835397632 00000100:00100000:3.0:1789683358.161264:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835397632 00000100:00100000:3.0:1789683358.161334:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:3.0:1789683358.161345:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ec036ece-1720-411a-849c-c978dbb41f8a+6:6161:x1876618835397632:12345-192.168.201.50@tcp:900: 00000100:00100000:3.0:1789683358.161474:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ec036ece-1720-411a-849c-c978dbb41f8a+6:6161:x1876618835397632:12345-192.168.201.50@tcp:900: Request processed in 131us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683358.161483:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:2.0:1789683358.162343:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835397376 00000100:00100000:2.0:1789683358.162351:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835397376 00000100:00100000:2.0:1789683358.162382:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:2.0:1789683358.162389:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1876618835397376:12345-192.168.201.50@tcp:8: 00010000:00080000:2.0:1789683358.162429:0:8676:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:2.0:1789683358.162466:0:8676:0:(genops.c:1384:class_connect()) connect: client ec036ece-1720-411a-849c-c978dbb41f8a, cookie 0xcf8485587b88961a 00002000:00100000:2.0:1789683358.162482:0:8676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ec036ece-1720-411a-849c-c978dbb41f8a/ffff9f0e83444800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789683358.162505:0:8676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1789683358.162722:0:8676:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789683358.162753:0:8676:0:(import.c:65:import_set_state_nolock()) ffff9f0e83447000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683358.163904:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683358.164066:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec036ece-1720-411a-849c-c978dbb41f8a+6:2401:x1876618835397376:12345-192.168.201.50@tcp:8: Request processed in 1675us (3085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683358.164076:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:2.0:1789683358.164106:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835397504 00000100:00100000:2.0:1789683358.164112:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835397504 00000100:00100000:2.0:1789683358.164153:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:2.0:1789683358.164159:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1876618835397504:12345-192.168.201.50@tcp:8: 00010000:00080000:2.0:1789683358.164188:0:8676:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:2.0:1789683358.164217:0:8676:0:(genops.c:1384:class_connect()) connect: client ec036ece-1720-411a-849c-c978dbb41f8a, cookie 0xcf8485587b889621 00002000:00100000:2.0:1789683358.164228:0:8676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ec036ece-1720-411a-849c-c978dbb41f8a/ffff9f0e83447800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789683358.164258:0:8676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1789683358.164840:0:8676:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789683358.164875:0:8676:0:(import.c:65:import_set_state_nolock()) ffff9f0e83446800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789683358.164934:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec036ece-1720-411a-849c-c978dbb41f8a+6:2401:x1876618835397504:12345-192.168.201.50@tcp:8: Request processed in 774us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683358.164942:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:1.0:1789683358.169692:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683358.169838:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835397760 00000100:00100000:2.0:1789683358.169848:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835397760 00000100:00100000:2.0:1789683358.169902:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 200 00000100:00100000:2.0:1789683358.169912:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+10:2404:x1876618835397760:12345-192.168.201.50@tcp:400: 00000100:00100000:2.0:1789683358.169972:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+10:2404:x1876618835397760:12345-192.168.201.50@tcp:400: Request processed in 62us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683358.169979:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 200 00000100:00100000:1.0:1789683358.178811:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683358.179217:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835397888 00000100:00100000:3.0:1789683358.179227:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835397888 00000100:00100000:3.0:1789683358.179357:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:3.0:1789683358.179367:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+6:6161:x1876618835397888:12345-192.168.201.50@tcp:33: 00000004:00080000:3.0:1789683358.222529:0:6524:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 43066us 00000004:00200000:3.0:1789683358.248926:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789683358.249045:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+6:6161:x1876618835397888:12345-192.168.201.50@tcp:33: Request processed in 69674us (70239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683358.249056:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:0.0:1789683358.304260:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850126720:0@lo:41: 00000100:00100000:0.0:1789683358.304356:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683358.304426:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850126720 00000100:00100000:3.0:1789683358.304442:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850126720 00000100:00100000:3.0:1789683358.304535:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789683358.304855:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850126720:12345-0@lo:41: 00000004:00000024:3.0:1789683358.304899:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789683358.306442:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850126720:12345-0@lo:41: Request processed in 1705us (1896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683358.306477:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789683358.306881:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850126720:0@lo:41: 00000100:00100000:1.0:1789683358.486231:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683358.486387:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835398016 00000100:00100000:2.0:1789683358.486400:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835398016 00000100:00100000:2.0:1789683358.486485:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:2.0:1789683358.486496:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+6:6204:x1876618835398016:12345-192.168.201.50@tcp:101: 00010000:00010000:2.0:1789683358.486523:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683358.487663:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b889628 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc433 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683358.490881:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88962f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683358.490904:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88962f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683358.490921:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88962f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683358.490987:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789683358.490991:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683358.491009:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88962f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683358.491039:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b889628 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc433 expref: 8 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683358.491061:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88962f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc433 expref: 7 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683358.491070:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f853e3300) 00010000:00010000:2.0:1789683358.491073:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683358.491076:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f9c00, rc 0) 00000100:00100000:2.0:1789683358.491156:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+7:6204:x1876618835398016:12345-192.168.201.50@tcp:101: Request processed in 4659us (4937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683358.491164:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00010000:00010000:3.0:1789683358.751169:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683358.817805:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850126848:0@lo:13: 00000100:00100000:2.0:1789683358.817882:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683358.818142:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850126848 00000100:00100000:3.0:1789683358.818153:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850126848 00000100:00100000:3.0:1789683358.818216:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789683358.818227:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850126848:12345-0@lo:13: 00002000:00000024:3.0:1789683358.818251:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683358.818295:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850126848:12345-0@lo:13: Request processed in 70us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683358.818302:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1789683358.818424:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789683358.818553:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f88cddf80 x1876618850126848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683358.818572:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850126848:0@lo:13: 00000100:00100000:3.0:1789683359.327268:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850127104:0@lo:13: 00000100:00100000:3.0:1789683359.327349:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683359.327427:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850126976:0@lo:41: 00000100:00100000:1.0:1789683359.327477:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683359.327556:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850127104 00000100:00100000:0.0:1789683359.327576:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850127104 00000100:00100000:0.0:1789683359.327669:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789683359.327680:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850127104:12345-0@lo:13: 00002000:00000024:0.0:1789683359.327704:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683359.327762:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850127104:12345-0@lo:13: Request processed in 85us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683359.327768:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789683359.327925:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83762680 x1876618850127104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683359.327945:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850127104:0@lo:13: 00000100:00100000:3.0:1789683359.328136:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850126976 00000100:00100000:3.0:1789683359.328141:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850126976 00000100:00100000:3.0:1789683359.328174:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789683359.328180:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850126976:12345-0@lo:41: 00000004:00000024:3.0:1789683359.328207:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789683359.328262:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850126976:12345-0@lo:41: Request processed in 82us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683359.328267:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789683359.328334:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850126976:0@lo:41: 00000100:00080000:1.0:1789683359.330083:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789683359.776943:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683360.746949:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683360.747093:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835398144 00000100:00100000:1.0:1789683360.747113:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835398144 00000100:00100000:1.0:1789683360.747186:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:1.0:1789683360.747196:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:6256:x1876618835398144:12345-192.168.201.50@tcp:41: 00000004:00000024:1.0:1789683360.747231:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:2.0:1789683360.747271:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683360.747297:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:6256:x1876618835398144:12345-192.168.201.50@tcp:41: Request processed in 101us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683360.747306:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:0.0:1789683360.752246:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683360.752351:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835398272 00000100:00100000:2.0:1789683360.752361:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835398272 00000100:00100000:2.0:1789683360.752440:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:2.0:1789683360.752460:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:6256:x1876618835398272:12345-192.168.201.50@tcp:41: 00000100:00080000:1.0:1789683360.752474:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:2.0:1789683360.752508:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789683360.752578:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:6256:x1876618835398272:12345-192.168.201.50@tcp:41: Request processed in 129us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683360.752585:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:2.0:1789683360.756994:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683360.757151:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835398400 00000100:00100000:0.0:1789683360.757160:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835398400 00000100:00100000:0.0:1789683360.757229:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:0.0:1789683360.757240:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec036ece-1720-411a-849c-c978dbb41f8a+6:6256:x1876618835398400:12345-192.168.201.50@tcp:13: 00002000:00000024:0.0:1789683360.757274:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683360.757345:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec036ece-1720-411a-849c-c978dbb41f8a+6:6256:x1876618835398400:12345-192.168.201.50@tcp:13: Request processed in 106us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683360.757352:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00080000:1.0:1789683360.757494:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683360.779965:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683360.783718:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835398528 00000100:00100000:2.0:1789683360.783735:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835398528 00000100:00100000:2.0:1789683360.783866:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:2.0:1789683360.783878:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec036ece-1720-411a-849c-c978dbb41f8a+6:6256:x1876618835398528:12345-192.168.201.50@tcp:13: 00002000:00000024:2.0:1789683360.783914:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683360.784007:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec036ece-1720-411a-849c-c978dbb41f8a+6:6256:x1876618835398528:12345-192.168.201.50@tcp:13: Request processed in 131us (4066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683360.784015:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00080000:1.0:1789683360.784345:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789683360.798990:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683360.863574:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850127232:0@lo:13: 00000100:00100000:1.0:1789683360.863679:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683360.864147:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850127232 00000100:00100000:0.0:1789683360.864158:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850127232 00000100:00100000:0.0:1789683360.864245:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789683360.864254:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850127232:12345-0@lo:13: 00002000:00000024:0.0:1789683360.864279:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683360.864345:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850127232:12345-0@lo:13: Request processed in 92us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683360.864353:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1789683360.864440:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc070c000 x1876618850127232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683360.864461:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850127232:0@lo:13: 00000100:00080000:1.0:1789683360.865733:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789683361.375343:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850127360:0@lo:400: 00000100:00100000:2.0:1789683361.375425:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683361.375475:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850127872:0@lo:400: 00000100:00100000:2.0:1789683361.375504:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683361.375526:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850128384:0@lo:400: 00000100:00100000:2.0:1789683361.375547:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683361.375565:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850128896:0@lo:400: 00000100:00100000:2.0:1789683361.375579:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683361.375595:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789683361.375599:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850127744:0@lo:400: 00000100:00100000:2.0:1789683361.375612:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683361.375639:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850128256:0@lo:400: 00000100:00100000:2.0:1789683361.375658:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683361.375673:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850128768:0@lo:400: 00000100:00100000:2.0:1789683361.375691:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683361.375717:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850127488:0@lo:400: 00000100:00100000:2.0:1789683361.375741:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683361.375760:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850128000:0@lo:400: 00000100:00100000:2.0:1789683361.375823:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683361.375840:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850128512:0@lo:400: 00000100:00100000:2.0:1789683361.375862:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683361.375886:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789683361.375893:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850127616:0@lo:400: 00000100:00100000:2.0:1789683361.375931:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683361.375952:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850128128:0@lo:400: 00000100:00100000:2.0:1789683361.375971:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683361.375981:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850128640:0@lo:400: 00000100:00100000:2.0:1789683361.376009:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683361.376040:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850127872 00000100:00100000:2.0:1789683361.376048:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850127872 00000100:00100000:2.0:1789683361.376107:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850127616 00000100:00100000:2.0:1789683361.376110:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850127616 00000100:00100000:2.0:1789683361.376127:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789683361.376135:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850127872:12345-0@lo:400: 00000100:00100000:2.0:1789683361.376192:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850127872:12345-0@lo:400: Request processed in 55us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683361.376198:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789683361.376213:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789683361.376218:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850127616:12345-0@lo:400: 00000100:00100000:2.0:1789683361.376262:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850127616:12345-0@lo:400: Request processed in 44us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683361.376268:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789683361.376287:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850128384 00000100:00100000:2.0:1789683361.376290:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850128384 00000100:00100000:2.0:1789683361.376321:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850128896 00000100:00100000:2.0:1789683361.376324:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850128896 00000100:00100000:2.0:1789683361.376337:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850128256 00000100:00100000:2.0:1789683361.376339:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850128256 00000100:00100000:2.0:1789683361.376350:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850128768 00000100:00100000:2.0:1789683361.376352:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850128768 00000100:00100000:2.0:1789683361.376362:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789683361.376367:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850128384:12345-0@lo:400: 00000100:00100000:2.0:1789683361.376395:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850128384:12345-0@lo:400: Request processed in 28us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683361.376401:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789683361.376412:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789683361.376425:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850128896:12345-0@lo:400: 00000100:00100000:2.0:1789683361.376453:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850128896:12345-0@lo:400: Request processed in 29us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683361.376459:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789683361.376468:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789683361.376473:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850128256:12345-0@lo:400: 00000100:00100000:2.0:1789683361.376494:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850128256:12345-0@lo:400: Request processed in 21us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683361.376500:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789683361.376508:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789683361.376513:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850128768:12345-0@lo:400: 00000100:00100000:2.0:1789683361.376534:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850128768:12345-0@lo:400: Request processed in 22us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683361.376539:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789683361.376559:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850127744 00000100:00100000:2.0:1789683361.376562:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850127744 00000100:00100000:2.0:1789683361.376577:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850127488 00000100:00100000:2.0:1789683361.376579:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850127488 00000100:00100000:2.0:1789683361.376587:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850128000 00000100:00100000:2.0:1789683361.376589:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850128000 00000100:00100000:2.0:1789683361.376599:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850128512 00000100:00100000:2.0:1789683361.376601:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850128512 00000100:00100000:2.0:1789683361.376610:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850128128 00000100:00100000:2.0:1789683361.376612:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850128128 00000100:00100000:2.0:1789683361.376634:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850128640 00000100:00100000:2.0:1789683361.376637:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850128640 00000100:00100000:2.0:1789683361.376650:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789683361.376655:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850127744:12345-0@lo:400: 00000100:00100000:2.0:1789683361.376683:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850127744:12345-0@lo:400: Request processed in 27us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683361.376695:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789683361.376707:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789683361.376712:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850127488:12345-0@lo:400: 00000100:00100000:2.0:1789683361.376737:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850127488:12345-0@lo:400: Request processed in 25us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683361.376742:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789683361.376751:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789683361.376756:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850128000:12345-0@lo:400: 00000100:00100000:2.0:1789683361.376778:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850128000:12345-0@lo:400: Request processed in 22us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683361.376804:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789683361.376815:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789683361.376820:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850128512:12345-0@lo:400: 00000100:00100000:2.0:1789683361.376843:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850128512:12345-0@lo:400: Request processed in 23us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683361.376848:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789683361.376857:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789683361.376862:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850128128:12345-0@lo:400: 00000100:00100000:2.0:1789683361.376883:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850128128:12345-0@lo:400: Request processed in 21us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683361.376888:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789683361.376897:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789683361.376902:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850128640:12345-0@lo:400: 00000100:00100000:2.0:1789683361.376921:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850128640:12345-0@lo:400: Request processed in 19us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683361.376934:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1789683361.376985:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789683361.376989:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683361.376991:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683361.376993:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683361.377018:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850127616:0@lo:400: 00010000:00080000:2.0:1789683361.377030:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb61f3100 x1876618850128128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683361.377040:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850128128:0@lo:400: 00010000:00080000:2.0:1789683361.377059:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83749880 x1876618850128640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683361.377067:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850128640:0@lo:400: 00000100:00100000:2.0:1789683361.377080:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850127488:0@lo:400: 00000100:00100000:2.0:1789683361.377089:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850128000:0@lo:400: 00000100:00100000:2.0:1789683361.377098:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850128512:0@lo:400: 00000100:00100000:2.0:1789683361.377133:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850127744:0@lo:400: 00010000:00080000:2.0:1789683361.377142:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb61f1c00 x1876618850128256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683361.377150:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850128256:0@lo:400: 00010000:00080000:2.0:1789683361.377160:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83748000 x1876618850128768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683361.377167:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850128768:0@lo:400: 00000100:00100000:2.0:1789683361.377183:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850127872:0@lo:400: 00010000:00080000:2.0:1789683361.377191:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb61f2d80 x1876618850128384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683361.377198:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850128384:0@lo:400: 00010000:00080000:2.0:1789683361.377207:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e8374b480 x1876618850128896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683361.377213:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850128896:0@lo:400: 00000100:00100000:3.0:1789683361.377876:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850127360 00000100:00100000:3.0:1789683361.377883:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850127360 00000100:00100000:3.0:1789683361.377985:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789683361.377994:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850127360:12345-0@lo:400: 00000100:00100000:3.0:1789683361.378045:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850127360:12345-0@lo:400: Request processed in 53us (2620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683361.378061:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789683361.378774:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850127360:0@lo:400: 00000100:00100000:2.0:1789683361.388431:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683361.388456:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850129024:0@lo:13: 00000100:00100000:2.0:1789683361.388523:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683361.388569:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850129024 00000100:00100000:2.0:1789683361.388576:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850129024 00000100:00100000:2.0:1789683361.388636:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789683361.388645:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850129024:12345-0@lo:13: 00002000:00000024:2.0:1789683361.388667:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683361.388706:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850129024:12345-0@lo:13: Request processed in 63us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683361.388712:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1789683361.388749:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0bda300 x1876618850129024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683361.388767:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850129024:0@lo:13: 00010000:00010000:2.0:1789683361.826063:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683362.848713:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789683362.918002:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec036ece-1720-411a-849c-c978dbb41f8a 00000001:00100000:2.0:1789683362.920173:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec036ece-1720-411a-849c-c978dbb41f8a 00000001:00100000:3.0:1789683362.924186:0:7455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ec036ece-1720-411a-849c-c978dbb41f8a 00000100:00100000:2.0:1789683363.351380:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683363.351432:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683363.351464:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683363.351488:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683363.351513:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683363.351514:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835398784 00000100:00100000:0.0:1789683363.351523:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835398784 00000100:00100000:2.0:1789683363.351533:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835399040 00000100:00100000:2.0:1789683363.351536:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835399040 00000100:00100000:2.0:1789683363.351579:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835399168 00000100:00100000:0.0:1789683363.351579:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835398912 00000100:00100000:2.0:1789683363.351591:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835399168 00000100:00100000:0.0:1789683363.351592:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835398912 00000100:00100000:2.0:1789683363.351616:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:0.0:1789683363.351616:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:2.0:1789683363.351625:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:2405:x1876618835399040:12345-192.168.201.50@tcp:400: 00000100:00100000:0.0:1789683363.351625:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:2405:x1876618835398784:12345-192.168.201.50@tcp:400: 00000100:00100000:2.0:1789683363.351695:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:2405:x1876618835399040:12345-192.168.201.50@tcp:400: Request processed in 70us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683363.351695:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:2405:x1876618835398784:12345-192.168.201.50@tcp:400: Request processed in 70us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683363.351703:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:0.0:1789683363.351703:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:2.0:1789683363.351722:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:0.0:1789683363.351722:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:2.0:1789683363.351729:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835399168:12345-192.168.201.50@tcp:400: 00000100:00100000:0.0:1789683363.351729:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835398912:12345-192.168.201.50@tcp:400: 00000100:00100000:2.0:1789683363.351752:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835399168:12345-192.168.201.50@tcp:400: Request processed in 24us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683363.351752:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835398912:12345-192.168.201.50@tcp:400: Request processed in 25us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683363.351759:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:0.0:1789683363.351759:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00080000:0.0:1789683363.351775:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789683363.351776:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835398656 00000100:00100000:2.0:1789683363.351779:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835398656 00000100:00080000:0.0:1789683363.351779:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683363.351800:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683363.351803:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683363.351824:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 202 00000100:00100000:2.0:1789683363.351830:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+10:2405:x1876618835398656:12345-192.168.201.50@tcp:400: 00000100:00100000:2.0:1789683363.351853:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+10:2405:x1876618835398656:12345-192.168.201.50@tcp:400: Request processed in 23us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683363.351859:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 202 00000100:00100000:3.0:1789683363.440445:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683363.440471:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850129152:0@lo:41: 00000100:00100000:3.0:1789683363.440542:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683363.440872:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850129152 00000100:00100000:2.0:1789683363.440882:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850129152 00000100:00100000:2.0:1789683363.440941:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789683363.440951:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8374ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850129152:12345-0@lo:41: 00000004:00000024:2.0:1789683363.440987:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789683363.441042:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8374ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850129152:12345-0@lo:41: Request processed in 92us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683363.441315:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850129152:0@lo:41: 00000100:00100000:2.0:1789683363.443398:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000001:02000400:3.0:1789683363.554184:0:10190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789683363.873872:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683363.934986:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683363.935012:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850129280:0@lo:13: 00000100:00100000:0.0:1789683363.935089:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683363.935195:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850129280 00000100:00100000:3.0:1789683363.935204:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850129280 00000100:00100000:3.0:1789683363.935282:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789683363.935293:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850129280:12345-0@lo:13: 00002000:00000024:3.0:1789683363.935323:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683363.935369:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850129280:12345-0@lo:13: Request processed in 78us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683363.935376:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1789683363.935434:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e8374b100 x1876618850129280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683363.935453:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850129280:0@lo:13: 00000100:00080000:0.0:1789683363.935677:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1789683363.940082:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec036ece-1720-411a-849c-c978dbb41f8a 00000100:00100000:0.0:1789683364.448729:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850129408:0@lo:41: 00000100:00100000:0.0:1789683364.448820:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683364.448913:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850129408 00000100:00100000:0.0:1789683364.448921:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850129408 00000100:00100000:0.0:1789683364.448967:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789683364.448976:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850129408:12345-0@lo:41: 00000004:00000024:0.0:1789683364.449024:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789683364.449539:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850129536:0@lo:13: 00000100:00100000:3.0:1789683364.449586:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683364.449627:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850129536 00000100:00100000:3.0:1789683364.449631:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850129536 00000100:00100000:3.0:1789683364.449670:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789683364.449677:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8374bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850129536:12345-0@lo:13: 00002000:00000024:3.0:1789683364.449694:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683364.449736:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8374bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850129536:12345-0@lo:13: Request processed in 60us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683364.449743:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1789683364.449798:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e8374b100 x1876618850129536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683364.449817:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850129536:0@lo:13: 00000100:00080000:3.0:1789683364.449858:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683364.450579:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850129408:12345-0@lo:41: Request processed in 1589us (1744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683364.450589:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789683364.450762:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850129408:0@lo:41: 00010000:00010000:3.0:1789683364.904587:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683365.938524:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683365.984494:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683365.984524:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850129664:0@lo:13: 00000100:00100000:3.0:1789683365.984609:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683365.984730:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850129664 00000100:00100000:0.0:1789683365.984739:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850129664 00000100:00100000:0.0:1789683365.984820:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789683365.984831:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8374b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850129664:12345-0@lo:13: 00002000:00000024:0.0:1789683365.984866:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683365.984916:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8374b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850129664:12345-0@lo:13: Request processed in 88us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683365.984923:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789683365.984987:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789683365.985022:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7960a80 x1876618850129664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683365.985040:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850129664:0@lo:13: 00000100:00100000:3.0:1789683366.496271:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850129792:0@lo:400: 00000100:00100000:3.0:1789683366.496390:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683366.496643:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850129792 00000100:00100000:1.0:1789683366.496670:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850129792 00000100:00100000:1.0:1789683366.496739:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789683366.496750:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850129792:12345-0@lo:400: 00000100:00100000:1.0:1789683366.496837:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850129792:12345-0@lo:400: Request processed in 89us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683366.496846:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789683366.496885:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850129920:0@lo:400: 00000100:00100000:1.0:1789683366.496917:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683366.496950:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850130048:0@lo:400: 00000100:00100000:1.0:1789683366.497015:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683366.497046:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850130176:0@lo:400: 00000100:00100000:1.0:1789683366.497070:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683366.497098:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850129920 00000100:00100000:1.0:1789683366.497102:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850129920 00000100:00100000:1.0:1789683366.497134:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850130176 00000100:00100000:1.0:1789683366.497137:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850130176 00000100:00100000:1.0:1789683366.497156:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789683366.497162:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850129920:12345-0@lo:400: 00000100:00100000:1.0:1789683366.497199:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850129920:12345-0@lo:400: Request processed in 37us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683366.497205:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789683366.497216:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789683366.497221:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850130176:12345-0@lo:400: 00000100:00100000:1.0:1789683366.497250:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850130176:12345-0@lo:400: Request processed in 29us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683366.497255:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789683366.497274:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850130048 00000100:00100000:1.0:1789683366.497283:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850130048 00000100:00100000:1.0:1789683366.497313:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789683366.497320:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850130048:12345-0@lo:400: 00000100:00100000:1.0:1789683366.497358:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850130048:12345-0@lo:400: Request processed in 39us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683366.497363:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789683366.497602:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850129792:0@lo:400: 00000100:00100000:3.0:1789683366.497629:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850130304:0@lo:400: 00000100:00100000:3.0:1789683366.497655:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683366.498109:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850129920:0@lo:400: 00000100:00100000:1.0:1789683366.498118:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850130432:0@lo:400: 00000100:00100000:1.0:1789683366.498148:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683366.498169:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850130944:0@lo:400: 00000100:00100000:1.0:1789683366.498190:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683366.499047:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850130432 00000100:00100000:1.0:1789683366.499060:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850130432 00000100:00100000:1.0:1789683366.499172:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850130944 00000100:00100000:1.0:1789683366.499177:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850130944 00000100:00080000:3.0:1789683366.499264:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683366.499375:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850130304 00000100:00100000:0.0:1789683366.499390:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850130304 00000100:00100000:0.0:1789683366.499460:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789683366.499469:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789683366.499475:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850130304:12345-0@lo:400: 00000100:00100000:1.0:1789683366.499484:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850130432:12345-0@lo:400: 00000100:00100000:1.0:1789683366.499596:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850130432:12345-0@lo:400: Request processed in 116us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683366.499605:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789683366.499613:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850130304:12345-0@lo:400: Request processed in 141us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683366.499627:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789683366.499633:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789683366.499643:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850130944:12345-0@lo:400: 00000100:00100000:0.0:1789683366.500239:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850130304:0@lo:400: 00000100:00100000:1.0:1789683366.500248:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850130944:12345-0@lo:400: Request processed in 604us (2053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683366.500256:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850130816:0@lo:400: 00000100:00100000:1.0:1789683366.500265:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789683366.500312:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683366.500394:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850130816 00000100:00100000:3.0:1789683366.500402:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850130816 00000100:00100000:3.0:1789683366.500577:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789683366.500585:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850130816:12345-0@lo:400: 00000100:00100000:3.0:1789683366.500667:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850130816:12345-0@lo:400: Request processed in 83us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683366.500675:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789683366.500696:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683366.500955:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850130176:0@lo:400: 00000100:00100000:3.0:1789683366.500968:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850130688:0@lo:400: 00000100:00100000:3.0:1789683366.501017:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683366.501042:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850131200:0@lo:400: 00000100:00100000:3.0:1789683366.501063:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683366.501290:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850130048:0@lo:400: 00000100:00100000:1.0:1789683366.501572:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850130560:0@lo:400: 00000100:00100000:1.0:1789683366.501612:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683366.501689:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850131072:0@lo:400: 00000100:00100000:1.0:1789683366.501727:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683366.501921:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850130560 00000100:00100000:3.0:1789683366.501928:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850130560 00000100:00100000:3.0:1789683366.502044:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850131072 00000100:00100000:3.0:1789683366.502049:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850131072 00000100:00100000:3.0:1789683366.502072:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789683366.502079:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850130560:12345-0@lo:400: 00000100:00100000:3.0:1789683366.502204:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850130560:12345-0@lo:400: Request processed in 124us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683366.502212:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789683366.502237:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789683366.502246:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850131072:12345-0@lo:400: 00000100:00100000:3.0:1789683366.502287:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850131072:12345-0@lo:400: Request processed in 44us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683366.502293:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1789683366.502615:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683366.502726:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850130432:0@lo:400: 00000100:00100000:1.0:1789683366.502742:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850130944:0@lo:400: 00000100:00100000:1.0:1789683366.502761:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683366.502771:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850131328:0@lo:13: 00000100:00100000:3.0:1789683366.503108:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850130688 00000100:00100000:3.0:1789683366.503115:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850130688 00000100:00100000:1.0:1789683366.503248:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683366.503290:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850131328 00000100:00100000:1.0:1789683366.503294:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850131328 00000100:00100000:1.0:1789683366.503698:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789683366.503707:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850131328:12345-0@lo:13: 00002000:00000024:1.0:1789683366.503745:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683366.503826:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850131328:12345-0@lo:13: Request processed in 121us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683366.503834:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789683366.503875:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7960a80 x1876618850131328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683366.503897:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850131328:0@lo:13: 00010000:00080000:1.0:1789683366.503932:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb799b100 x1876618850130560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683366.503944:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850130560:0@lo:400: 00010000:00080000:1.0:1789683366.503959:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7999c00 x1876618850131072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683366.503998:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850131072:0@lo:400: 00000100:00100000:2.0:1789683366.504179:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850131200 00000100:00100000:2.0:1789683366.504200:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850131200 00000100:00100000:2.0:1789683366.504279:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789683366.504290:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8374b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850131200:12345-0@lo:400: 00000100:00080000:1.0:1789683366.504686:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683366.504692:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683366.504763:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789683366.504771:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb799bb80 x1876618850130816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683366.504815:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850130688:12345-0@lo:400: 00000100:00100000:0.0:1789683366.504971:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850130816:0@lo:400: 00000100:00100000:2.0:1789683366.505610:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8374b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850131200:12345-0@lo:400: Request processed in 1319us (4543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683366.505621:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683366.511089:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850130688:12345-0@lo:400: Request processed in 6284us (10051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683366.511110:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789683366.511393:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb799ad80 x1876618850130688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683366.511434:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850130688:0@lo:400: 00010000:00080000:2.0:1789683366.512097:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e81d40000 x1876618850131200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683366.512108:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850131200:0@lo:400: 00010000:00010000:3.0:1789683366.943384:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789683367.721889:0:10337:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffedda1eb00 20000000:00000080:2.0:1789683367.721908:0:10337:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0fc149c800 uarg=0000000000000000 20000000:01000000:2.0:1789683367.722069:0:10337:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789683367.722071:0:10337:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789683367.722074:0:10337:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789683367.722079:0:10337:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789683367.722084:0:10337:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789683367.722141:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789683367.722150:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789683367.722757:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1789683367.723359:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1789683367.723389:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1789683367.723406:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1789683367.723416:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789683367.723419:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789683367.724218:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1789683367.724398:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1789683367.724422:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1789683367.724438:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1789683367.724449:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789683367.724452:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789683367.724779:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1789683367.725655:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1789683367.725681:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1789683367.725696:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1789683367.725708:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789683367.725709:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789683367.728297:0:10341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1789683367.728728:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1789683367.728760:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1789683367.728778:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1789683367.729214:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789683367.729217:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789683367.729594:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1789683367.729779:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1789683367.730123:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1789683367.730137:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:2.0:1789683367.730149:0:10337:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789683367.730168:0:10337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b889636 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730184:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f81676c00/0xcf8485587b8894d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8894ca expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730191:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8894fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8894f4 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730196:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88953a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889533 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730202:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f81676e00/0xcf8485587b889548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889541 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730207:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f81677200/0xcf8485587b889556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88954f expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730213:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f829e1000/0xcf8485587b889572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88956b expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730218:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f829e0e00/0xcf8485587b88959c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889595 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730231:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f80031200/0xcf8485587b8895b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8895b1 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730237:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0e837dba00/0xcf8485587b8895e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8895db expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730245:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0e837da400/0xcf8485587b8895f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3c3 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730252:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0e837da800/0xcf8485587b8895f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3ca expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730257:0:10337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b889636 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730293:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0e837da800/0xcf8485587b8895f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3ca expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730306:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0e837da800/0xcf8485587b8895f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3ca expref: 9 pid: 6514 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683367.730320:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d40000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850131456:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683367.730475:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0e837da400/0xcf8485587b8895f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3c3 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730484:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0e837da400/0xcf8485587b8895f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3c3 expref: 9 pid: 6514 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683367.730493:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bda300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850131584:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683367.730545:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0e837dba00/0xcf8485587b8895e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b8895db expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730553:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0e837dba00/0xcf8485587b8895e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b8895db expref: 23 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683367.730563:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850131712:0@lo:104: 00000100:00100000:2.0:1789683367.730598:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789683367.730629:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f80031200/0xcf8485587b8895b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b8895b1 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730638:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f80031200/0xcf8485587b8895b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b8895b1 expref: 23 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683367.730645:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850131840:0@lo:104: 00000100:00100000:2.0:1789683367.730662:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789683367.730708:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f829e0e00/0xcf8485587b88959c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b889595 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730715:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f829e0e00/0xcf8485587b88959c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b889595 expref: 23 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683367.730722:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850131968:0@lo:104: 00000100:00100000:2.0:1789683367.730741:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789683367.730753:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f829e1000/0xcf8485587b889572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88956b expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730760:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f829e1000/0xcf8485587b889572 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88956b expref: 23 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683367.730779:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850132096:0@lo:104: 00000100:00100000:2.0:1789683367.730843:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789683367.730866:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f81677200/0xcf8485587b889556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88954f expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730874:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f81677200/0xcf8485587b889556 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88954f expref: 23 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683367.730883:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d14a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850132224:0@lo:104: 00010000:00010000:2.0:1789683367.730905:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f81676e00/0xcf8485587b889548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b889541 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730912:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f81676e00/0xcf8485587b889548 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b889541 expref: 23 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683367.730920:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850132352:0@lo:104: 00010000:00010000:2.0:1789683367.730956:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88953a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b889533 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.730964:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88953a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b889533 expref: 23 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683367.731087:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789683367.731107:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683367.731119:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683367.731128:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850131712 00000100:00100000:3.0:1789683367.731135:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850131712 00000100:00100000:3.0:1789683367.731177:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850131840 00000100:00100000:3.0:1789683367.731180:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850131840 00000100:00100000:3.0:1789683367.731190:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850131968 00000100:00100000:3.0:1789683367.731193:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850131968 00000100:00100000:3.0:1789683367.731222:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850132096 00000100:00100000:3.0:1789683367.731225:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850132096 00000100:00100000:3.0:1789683367.731233:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850132224 00000100:00100000:3.0:1789683367.731235:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850132224 00000100:00100000:3.0:1789683367.731240:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850132352 00000100:00100000:3.0:1789683367.731243:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850132352 00000100:00100000:3.0:1789683367.731253:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789683367.731261:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+8:10337:x1876618850131712:12345-0@lo:104: 00010000:00010000:3.0:1789683367.731273:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8895db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8895e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.731330:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789683367.731336:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+8:10337:x1876618850131712:12345-0@lo:104: Request processed in 77us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683367.731344:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789683367.731361:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789683367.731367:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+7:10337:x1876618850131840:12345-0@lo:104: 00010000:00010000:3.0:1789683367.731374:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b8895b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8895b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.731405:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789683367.731409:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+7:10337:x1876618850131840:12345-0@lo:104: Request processed in 43us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683367.731414:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789683367.731425:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789683367.731431:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+6:10337:x1876618850131968:12345-0@lo:104: 00010000:00010000:3.0:1789683367.731438:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88959c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.731482:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789683367.731487:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+6:10337:x1876618850131968:12345-0@lo:104: Request processed in 57us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683367.731493:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789683367.731519:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789683367.731526:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81f99850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:10337:x1876618850132096:12345-0@lo:104: 00010000:00010000:3.0:1789683367.731535:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b88956b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889572 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.731570:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789683367.731574:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81f99850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:10337:x1876618850132096:12345-0@lo:104: Request processed in 51us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683367.731579:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789683367.731607:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789683367.731612:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:10337:x1876618850132224:12345-0@lo:104: 00010000:00010000:3.0:1789683367.731619:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f81390e00/0xcf8485587b88954f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889556 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.731642:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789683367.731646:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:10337:x1876618850132224:12345-0@lo:104: Request processed in 35us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683367.731651:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789683367.731664:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789683367.731669:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83748700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:10337:x1876618850132352:12345-0@lo:104: 00010000:00010000:3.0:1789683367.731676:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889548 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.731707:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1789683367.731711:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83748700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:10337:x1876618850132352:12345-0@lo:104: Request processed in 43us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683367.731716:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1789683367.731739:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1789683367.731744:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8895db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8895e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.731751:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8000 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683367.731755:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8895db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8895e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.731763:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8895db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8895e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683367.731770:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8895db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8895e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683367.731775:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683367.731829:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8895db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8895e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.731835:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683367.731854:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8895db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8895e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.731860:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8895db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8895e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.731883:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789683367.731886:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b8895b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8895b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.731892:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f80030c00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683367.731895:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b8895b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8895b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.731902:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b8895b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8895b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683367.731908:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b8895b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8895b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683367.731913:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683367.731928:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b8895b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8895b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.731934:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683367.731949:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b8895b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8895b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.731955:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b8895b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8895b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.731964:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:2.0:1789683367.732082:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850132480:0@lo:104: 00010000:00010000:2.0:1789683367.732096:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789683367.732100:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b88956b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889572 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.732107:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f829e0c00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683367.732117:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b88956b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b889572 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.732123:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b88956b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b889572 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683367.732129:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b88956b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b889572 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683367.732134:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789683367.732155:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b88956b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889572 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.732160:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683367.732165:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b88956b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889572 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.732171:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0c00/0xcf8485587b88956b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889572 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.732181:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683367.732184:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f81390e00/0xcf8485587b88954f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889556 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.732189:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81390e00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683367.732192:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81390e00/0xcf8485587b88954f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b889556 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.732198:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f81390e00/0xcf8485587b88954f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b889556 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683367.732214:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81390e00/0xcf8485587b88954f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b889556 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683367.732219:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789683367.732232:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f81390e00/0xcf8485587b88954f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889556 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.732237:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683367.732242:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f81390e00/0xcf8485587b88954f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889556 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.732248:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f81390e00/0xcf8485587b88954f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889556 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.732258:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683367.732261:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889548 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.732266:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677e00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683367.732269:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b889548 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.732275:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b889548 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683367.732281:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b889548 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683367.732286:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789683367.732303:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889541 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889548 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.732309:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683367.732313:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889541 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889548 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.732319:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f81677e00/0xcf8485587b889541 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889548 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.732330:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683367.732331:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683367.732333:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683367.732341:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683367.732353:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850132864:0@lo:103: 00000100:00100000:2.0:1789683367.732387:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683367.732421:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683367.732427:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850132736:0@lo:103: 00000100:00100000:2.0:1789683367.732448:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683367.732489:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789683367.732526:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8894fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b8894f4 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.732537:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8894fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b8894f4 expref: 23 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683367.732545:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d16300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850133248:0@lo:104: 00000100:00100000:2.0:1789683367.732566:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789683367.732582:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f81676c00/0xcf8485587b8894d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b8894ca expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683367.732602:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f81676c00/0xcf8485587b8894d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b8894ca expref: 23 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683367.732611:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d14e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850133376:0@lo:104: 00000100:00100000:2.0:1789683367.732633:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683367.732644:0:10337:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e837200c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683367.732663:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850131712:0@lo:104: 00000100:00100000:2.0:1789683367.732671:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850131840:0@lo:104: 00000100:00100000:2.0:1789683367.732679:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850131968:0@lo:104: 00000100:00100000:2.0:1789683367.732685:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850132096:0@lo:104: 00000100:00100000:2.0:1789683367.732692:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d14a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850132224:0@lo:104: 00000100:00100000:2.0:1789683367.732699:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850132352:0@lo:104: 00010000:00010000:3.0:1789683367.732744:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88959c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.732761:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f829e1c00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683367.732765:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88959c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.732772:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88959c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683367.732778:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88959c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683367.732808:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683367.732824:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889595 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88959c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.732829:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683367.732844:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889595 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88959c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.732850:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889595 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88959c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.732860:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683367.732861:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683367.732863:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683367.732870:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683367.732880:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850132480 00000100:00100000:3.0:1789683367.732886:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850132480 00000100:00100000:3.0:1789683367.732908:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850133248 00000100:00100000:3.0:1789683367.732911:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850133248 00000100:00100000:3.0:1789683367.732918:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850133376 00000100:00100000:3.0:1789683367.732925:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850133376 00000100:00100000:3.0:1789683367.732937:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789683367.732943:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:10337:x1876618850132480:12345-0@lo:104: 00010000:00010000:3.0:1789683367.732952:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f81676200/0xcf8485587b889533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88953a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.733150:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789683367.733156:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:10337:x1876618850132480:12345-0@lo:104: Request processed in 213us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683367.733163:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789683367.733177:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789683367.733183:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:10337:x1876618850133248:12345-0@lo:104: 00010000:00010000:3.0:1789683367.733191:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b8894f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8894fb expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.733220:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789683367.733225:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:10337:x1876618850133248:12345-0@lo:104: Request processed in 42us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683367.733230:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789683367.733242:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789683367.733248:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:10337:x1876618850133376:12345-0@lo:104: 00010000:00010000:3.0:1789683367.733255:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b8894ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8894d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.733283:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789683367.733287:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:10337:x1876618850133376:12345-0@lo:104: Request processed in 41us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683367.733292:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1789683367.733313:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789683367.733318:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f81676200/0xcf8485587b889533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88953a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.733324:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81676200 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683367.733328:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81676200/0xcf8485587b889533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88953a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.733335:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f81676200/0xcf8485587b889533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88953a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683367.733341:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81676200/0xcf8485587b889533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88953a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683367.733346:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683367.733360:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f81676200/0xcf8485587b889533 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88953a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.733366:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683367.733373:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f81676200/0xcf8485587b889533 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88953a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.733379:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f81676200/0xcf8485587b889533 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88953a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.733390:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683367.733393:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b8894f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8894fb expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.733399:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81391400 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683367.733402:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b8894f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8894fb expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.733415:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b8894f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8894fb expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683367.733421:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b8894f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8894fb expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683367.733426:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683367.733439:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b8894f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8894fb expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.733444:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683367.733450:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b8894f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8894fb expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.733457:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b8894f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8894fb expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.733466:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683367.733468:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b8894ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8894d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.733473:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8e00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683367.733475:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b8894ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8894d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.733481:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b8894ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8894d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683367.733486:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b8894ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8894d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683367.733496:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683367.733524:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b8894ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8894d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.733529:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683367.733534:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b8894ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8894d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.733539:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b8894ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8894d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.733553:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683367.733554:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683367.733556:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683367.734170:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850133632:0@lo:103: 00000100:00100000:2.0:1789683367.734210:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683367.734255:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683367.734261:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850133504:0@lo:103: 00000100:00100000:2.0:1789683367.734282:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789683367.734299:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683367.734304:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683367.734333:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850132480:0@lo:104: 00000100:00100000:2.0:1789683367.734343:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d16300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850133248:0@lo:104: 00000100:00100000:2.0:1789683367.734350:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d14e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850133376:0@lo:104: 00000100:00100000:3.0:1789683367.734413:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850132864 00000100:00100000:3.0:1789683367.734420:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850132864 00010000:00010000:3.0:1789683367.734445:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f829e1000/0xcf8485587b889572 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88956b expref: 24 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683367.734461:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850132736 00000100:00100000:3.0:1789683367.734464:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850132736 00010000:00010000:3.0:1789683367.734472:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f80031200/0xcf8485587b8895b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8895b1 expref: 25 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683367.734480:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850133632 00000100:00100000:3.0:1789683367.734482:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850133632 00010000:00010000:3.0:1789683367.734490:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88953a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889533 expref: 26 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683367.734497:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850133504 00000100:00100000:3.0:1789683367.734519:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850133504 00010000:00010000:3.0:1789683367.734532:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f829e0e00/0xcf8485587b88959c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889595 expref: 27 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683367.734546:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789683367.734552:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb29f9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+27:3650:x1876618850132864:12345-0@lo:103: 00010000:00010000:3.0:1789683367.734561:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683367.734566:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f829e1000/0xcf8485587b889572 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88956b expref: 27 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.734576:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f829e1000/0xcf8485587b889572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88956b expref: 27 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.734588:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f829e1000/0xcf8485587b889572 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88956b expref: 27 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.734601:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683367.734641:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb29f9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+26:3650:x1876618850132864:12345-0@lo:103: Request processed in 89us (2252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683367.734647:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789683367.734683:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789683367.734688:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+25:3650:x1876618850132736:12345-0@lo:103: 00010000:00010000:3.0:1789683367.734695:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683367.734699:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f80031200/0xcf8485587b8895b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8895b1 expref: 25 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.734706:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f80031200/0xcf8485587b8895b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b8895b1 expref: 25 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.734715:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f80031200/0xcf8485587b8895b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b8895b1 expref: 25 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.734728:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683367.734749:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3650:x1876618850132736:12345-0@lo:103: Request processed in 61us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683367.734754:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789683367.734765:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789683367.734770:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:3650:x1876618850133632:12345-0@lo:103: 00010000:00010000:3.0:1789683367.734776:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683367.734780:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88953a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889533 expref: 23 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683367.734929:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850132608:0@lo:103: 00000100:00100000:1.0:1789683367.734959:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683367.734986:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850133120:0@lo:103: 00000100:00100000:1.0:1789683367.735007:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683367.735016:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850133888:0@lo:103: 00000100:00100000:1.0:1789683367.735028:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683367.735039:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789683367.735045:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850132992:0@lo:103: 00000100:00100000:1.0:1789683367.735064:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683367.735071:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850133760:0@lo:103: 00000100:00100000:1.0:1789683367.735085:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683367.735276:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850132736:0@lo:103: 00000100:00100000:2.0:1789683367.735296:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850132864:0@lo:103: 00010000:00010000:3.0:1789683367.735349:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88953a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b889533 expref: 23 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.735360:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81677a00/0xcf8485587b88953a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b889533 expref: 23 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.735370:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683367.735465:0:6506:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789683367.735473:0:6506:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789683367.735623:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850132608 00000100:00100000:1.0:1789683367.735628:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850132608 00010000:00010000:1.0:1789683367.735648:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0e837dba00/0xcf8485587b8895e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8895db expref: 23 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683367.735665:0:6506:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789683367.735669:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850133120 00000100:00100000:1.0:1789683367.735671:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850133120 00010000:00010000:1.0:1789683367.735680:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f81676e00/0xcf8485587b889548 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889541 expref: 24 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683367.735702:0:6506:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789683367.735706:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850133888 00000100:00100000:1.0:1789683367.735709:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850133888 00010000:00010000:1.0:1789683367.735720:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f81676c00/0xcf8485587b8894d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8894ca expref: 25 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683367.735730:0:6506:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789683367.735734:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850132992 00000100:00100000:1.0:1789683367.735736:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850132992 00010000:00010000:1.0:1789683367.735745:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f81677200/0xcf8485587b889556 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88954f expref: 26 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683367.735754:0:6506:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789683367.735758:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850133760 00000100:00100000:1.0:1789683367.735760:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850133760 00010000:00010000:1.0:1789683367.735769:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8894fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8894f4 expref: 27 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683367.735778:0:6506:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789683367.735820:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789683367.735827:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+27:3650:x1876618850133504:12345-0@lo:103: 00010000:00010000:1.0:1789683367.735837:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683367.735841:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f829e0e00/0xcf8485587b88959c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889595 expref: 27 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683367.735849:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f829e0e00/0xcf8485587b88959c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b889595 expref: 27 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683367.735858:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f829e0e00/0xcf8485587b88959c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b889595 expref: 27 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683367.735878:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683367.735947:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+26:3650:x1876618850133632:12345-0@lo:103: Request processed in 1176us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683367.735954:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789683367.735979:0:6508:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789683367.735985:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789683367.735991:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+25:3648:x1876618850132608:12345-0@lo:103: 00010000:00010000:3.0:1789683367.735997:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683367.736001:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0e837dba00/0xcf8485587b8895e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8895db expref: 25 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.736018:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0e837dba00/0xcf8485587b8895e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b8895db expref: 25 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.736028:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837dba00/0xcf8485587b8895e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b8895db expref: 25 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.736036:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683367.736066:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850132608:12345-0@lo:103: Request processed in 75us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683367.736072:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789683367.736084:0:6508:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789683367.736089:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789683367.736094:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:3648:x1876618850133120:12345-0@lo:103: 00010000:00010000:3.0:1789683367.736100:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683367.736104:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f81676e00/0xcf8485587b889548 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889541 expref: 23 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.736112:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f81676e00/0xcf8485587b889548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b889541 expref: 23 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.736121:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81676e00/0xcf8485587b889548 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b889541 expref: 23 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.736129:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683367.736147:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:3648:x1876618850133120:12345-0@lo:103: Request processed in 53us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683367.736152:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789683367.736161:0:6508:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789683367.736171:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789683367.736176:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:3648:x1876618850133888:12345-0@lo:103: 00010000:00010000:3.0:1789683367.736183:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683367.736187:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f81676c00/0xcf8485587b8894d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8894ca expref: 21 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.736194:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f81676c00/0xcf8485587b8894d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b8894ca expref: 21 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.736203:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81676c00/0xcf8485587b8894d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b8894ca expref: 21 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.736211:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683367.736233:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:3648:x1876618850133888:12345-0@lo:103: Request processed in 57us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683367.736238:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789683367.736248:0:6508:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789683367.736253:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789683367.736258:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb29f9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+19:3648:x1876618850132992:12345-0@lo:103: 00010000:00010000:3.0:1789683367.736264:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683367.736268:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f81677200/0xcf8485587b889556 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88954f expref: 19 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.736275:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f81677200/0xcf8485587b889556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88954f expref: 19 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.736284:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81677200/0xcf8485587b889556 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88954f expref: 19 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.736292:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683367.736318:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb29f9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:3648:x1876618850132992:12345-0@lo:103: Request processed in 60us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683367.736323:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789683367.736333:0:6508:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789683367.736338:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789683367.736343:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:3648:x1876618850133760:12345-0@lo:103: 00010000:00010000:3.0:1789683367.736350:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683367.736353:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8894fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8894f4 expref: 17 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.736360:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8894fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b8894f4 expref: 17 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.736368:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f829e0800/0xcf8485587b8894fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b8894f4 expref: 17 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683367.736375:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683367.736393:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:3648:x1876618850133760:12345-0@lo:103: Request processed in 50us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683367.736398:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789683367.736424:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850132992:0@lo:103: 00000100:00100000:3.0:1789683367.736430:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850133760:0@lo:103: 00000100:00100000:3.0:1789683367.736436:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850132608:0@lo:103: 00000100:00100000:3.0:1789683367.736441:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850133120:0@lo:103: 00000100:00100000:3.0:1789683367.736447:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850133888:0@lo:103: 00000100:00100000:1.0:1789683367.738182:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:3650:x1876618850133504:12345-0@lo:103: Request processed in 2347us (3890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683367.738193:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789683367.738298:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850133632:0@lo:103: 00000100:00100000:2.0:1789683367.738321:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850133504:0@lo:103: 00000100:00100000:2.0:1789683367.741446:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683367.741539:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683367.741730:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835399296 00000100:00100000:1.0:1789683367.741739:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835399296 00010000:00010000:1.0:1789683367.741778:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0e837da800/0xcf8485587b8895f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3ca expref: 10 pid: 6514 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683367.741840:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835399424 00000100:00100000:1.0:1789683367.741844:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835399424 00010000:00010000:1.0:1789683367.741858:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0e837da400/0xcf8485587b8895f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3c3 expref: 11 pid: 6514 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683367.741878:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:1.0:1789683367.741887:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea7031b9-febc-4826-a965-62f420153ef7+11:2403:x1876618835399296:12345-192.168.201.50@tcp:103: 00010000:00010000:1.0:1789683367.741900:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683367.741906:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0e837da800/0xcf8485587b8895f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3ca expref: 11 pid: 6514 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683367.741927:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0e837da800/0xcf8485587b8895f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3ca expref: 11 pid: 6514 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683367.741948:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683367.742007:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea7031b9-febc-4826-a965-62f420153ef7+11:2403:x1876618835399296:12345-192.168.201.50@tcp:103: Request processed in 120us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683367.742015:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:1.0:1789683367.742032:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:1.0:1789683367.742050:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea7031b9-febc-4826-a965-62f420153ef7+10:2403:x1876618835399424:12345-192.168.201.50@tcp:103: 00010000:00010000:1.0:1789683367.742058:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683367.742063:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0e837da400/0xcf8485587b8895f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3c3 expref: 10 pid: 6514 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683367.742072:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0e837da400/0xcf8485587b8895f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3c3 expref: 10 pid: 6514 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683367.742084:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b889636 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683367.742092:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b889636 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683367.742107:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b889636 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683367.742114:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b889636 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683367.742121:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b889636 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683367.742127:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b889636 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683367.742133:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683367.742137:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b889636 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683367.742144:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b889636 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683367.742160:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b889636 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683367.742170:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683367.742191:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea7031b9-febc-4826-a965-62f420153ef7+10:2403:x1876618835399424:12345-192.168.201.50@tcp:103: Request processed in 142us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683367.742198:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 34 00010000:00010000:0.0:1789683367.743666:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837da800/0xcf8485587b8895f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3ca expref: 9 pid: 6514 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683367.743686:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d40000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850131456:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683367.743699:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837da400/0xcf8485587b8895f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3c3 expref: 8 pid: 6514 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683367.743707:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bda300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1876618850131584:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683367.743759:0:10337:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b889636 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683367.743770:0:10337:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b889636 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683367.743776:0:10337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b889636 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683367.743813:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b889636 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683367.974854:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683368.475960:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683368.476135:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835399552 00000100:00100000:2.0:1789683368.476151:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835399552 00000100:00100000:2.0:1789683368.476236:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 204 00000100:00100000:2.0:1789683368.476249:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+8:2405:x1876618835399552:12345-192.168.201.50@tcp:400: 00000100:00100000:2.0:1789683368.476368:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+8:2405:x1876618835399552:12345-192.168.201.50@tcp:400: Request processed in 121us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683368.476377:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 204 00000100:00100000:0.0:1789683368.476550:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683368.476685:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835399808 00000100:00100000:1.0:1789683368.476695:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835399808 00000100:00100000:1.0:1789683368.476772:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:1.0:1789683368.476822:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835399808:12345-192.168.201.50@tcp:400: 00000100:00100000:1.0:1789683368.476897:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835399808:12345-192.168.201.50@tcp:400: Request processed in 117us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683368.476905:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00080000:2.0:1789683368.477044:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789683368.483544:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683368.487366:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683368.487442:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683368.487626:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835399680 00000100:00100000:1.0:1789683368.487642:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835399680 00000100:00100000:1.0:1789683368.487743:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:1.0:1789683368.487754:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+6:2405:x1876618835399680:12345-192.168.201.50@tcp:400: 00000100:00100000:1.0:1789683368.487876:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+6:2405:x1876618835399680:12345-192.168.201.50@tcp:400: Request processed in 123us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683368.487883:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00080000:3.0:1789683368.488349:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683368.493807:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835400064 00000100:00100000:2.0:1789683368.493830:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835400064 00000100:00100000:2.0:1789683368.493964:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835399936 00000100:00100000:2.0:1789683368.493969:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835399936 00000100:00100000:2.0:1789683368.494012:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:2.0:1789683368.494034:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835400064:12345-192.168.201.50@tcp:400: 00000100:00100000:1.0:1789683368.494119:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:1.0:1789683368.494149:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835399936:12345-192.168.201.50@tcp:400: 00000100:00100000:2.0:1789683368.494161:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835400064:12345-192.168.201.50@tcp:400: Request processed in 136us (10629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683368.494171:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:1.0:1789683368.494238:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835399936:12345-192.168.201.50@tcp:400: Request processed in 103us (6792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683368.494264:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00080000:0.0:1789683368.494850:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683368.494856:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683368.543149:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850134016:0@lo:41: 00000100:00100000:0.0:1789683368.543416:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683368.546540:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850134016 00000100:00100000:1.0:1789683368.546562:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850134016 00000100:00100000:1.0:1789683368.546703:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789683368.546714:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850134016:12345-0@lo:41: 00000004:00000024:1.0:1789683368.546753:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789683368.546880:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850134016:12345-0@lo:41: Request processed in 168us (3473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683368.546887:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789683368.547005:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850134016:0@lo:41: 00000100:00100000:1.0:1789683368.727237:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683368.727444:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835400192 00000100:00100000:2.0:1789683368.727456:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835400192 00000100:00100000:2.0:1789683368.727594:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 205 00000100:00100000:2.0:1789683368.727607:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+8:6175:x1876618835400192:12345-192.168.201.50@tcp:101: 00010000:00010000:2.0:1789683368.727628:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683368.727671:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f9400/0xcf8485587b88963d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc43a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683368.727704:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f9400/0xcf8485587b88963d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc43a expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683368.727717:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f9400/0xcf8485587b88963d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc43a expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683368.727726:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f9400, rc 0) 00000100:00100000:2.0:1789683368.727907:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+9:6175:x1876618835400192:12345-192.168.201.50@tcp:101: Request processed in 300us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683368.727914:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 205 00000100:00100000:2.0:1789683368.737922:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683368.741820:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835400320 00000100:00100000:1.0:1789683368.741838:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835400320 00000100:00100000:1.0:1789683368.741997:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 206 00000100:00100000:1.0:1789683368.742010:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+9:6175:x1876618835400320:12345-192.168.201.50@tcp:501: 00000100:00100000:1.0:1789683368.742225:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+9:6175:x1876618835400320:12345-192.168.201.50@tcp:501: Request processed in 218us (4309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683368.742234:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 206 00000100:00100000:0.0:1789683368.745730:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683368.745887:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835400448 00000100:00100000:3.0:1789683368.745897:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835400448 00000100:00100000:3.0:1789683368.745961:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 207 00000100:00100000:3.0:1789683368.745971:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+9:6175:x1876618835400448:12345-192.168.201.50@tcp:503: 00000100:00100000:3.0:1789683368.746125:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+9:6175:x1876618835400448:12345-192.168.201.50@tcp:503: Request processed in 154us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683368.746671:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 207 00000100:00100000:3.0:1789683368.753062:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683368.753626:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835400576 00000100:00100000:1.0:1789683368.753638:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835400576 00000100:00100000:1.0:1789683368.753903:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 208 00000100:00100000:1.0:1789683368.753914:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+9:6651:x1876618835400576:12345-192.168.201.50@tcp:502: 00000100:00100000:1.0:1789683368.754088:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+9:6651:x1876618835400576:12345-192.168.201.50@tcp:502: Request processed in 176us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683368.754096:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 208 00000100:00100000:0.0:1789683368.760902:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683368.761311:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835400704 00000100:00100000:2.0:1789683368.761322:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835400704 00000100:00100000:2.0:1789683368.761506:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 209 00000100:00100000:2.0:1789683368.761519:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+9:6651:x1876618835400704:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789683368.762085:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+9:6651:x1876618835400704:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 566us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683368.762093:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 209 00000100:00100000:0.0:1789683368.767444:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683368.767532:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835400832 00000100:00100000:3.0:1789683368.767542:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835400832 00000100:00100000:3.0:1789683368.767591:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 210 00000100:00100000:3.0:1789683368.767600:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+9:6175:x1876618835400832:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683368.767621:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683368.767641:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f829e0800/0xcf8485587b889644 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc441 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683368.767672:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f829e0800/0xcf8485587b889644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc441 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683368.767684:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f829e0800/0xcf8485587b889644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc441 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683368.767694:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e0800, rc 0) 00000100:00100000:3.0:1789683368.767821:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+10:6175:x1876618835400832:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 Request processed in 185us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683368.767829:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 210 00000100:00100000:2.0:1789683368.773818:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683368.774068:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835400960 00000100:00100000:1.0:1789683368.774091:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835400960 00000100:00100000:1.0:1789683368.774189:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 211 00000100:00100000:1.0:1789683368.774210:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+10:6175:x1876618835400960:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683368.774346:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+10:6175:x1876618835400960:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 Request processed in 148us (580us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789683368.774354:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 211 00010000:00010000:3.0:1789683368.991200:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683369.060264:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683369.060291:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850134144:0@lo:13: 00000100:00100000:0.0:1789683369.060421:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683369.060693:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850134144 00000100:00100000:1.0:1789683369.060702:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850134144 00000100:00100000:1.0:1789683369.060775:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789683369.060807:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850134144:12345-0@lo:13: 00002000:00000024:1.0:1789683369.060838:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683369.060897:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850134144:12345-0@lo:13: Request processed in 114us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683369.060903:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789683369.061130:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb790ce00 x1876618850134144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683369.061164:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850134144:0@lo:13: 00000100:00080000:0.0:1789683369.061240:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1789683369.311891:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789683369.311899:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0e827aa000 from 48 10000000:01000000:1.0:1789683369.311904:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789683369.311965:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbe00/0xcf8485587b88964b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.311977:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbe00/0xcf8485587b88964b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.311990:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbe00/0xcf8485587b88964b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683369.312015:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850134272:0@lo:101: 00000100:00100000:1.0:1789683369.312087:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683369.312157:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865ea6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683369.319175:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850134272 00000100:00100000:3.0:1789683369.319209:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850134272 00000100:00100000:3.0:1789683369.319274:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789683369.319284:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+15:6518:x1876618850134272:12345-0@lo:101: 00010000:00010000:3.0:1789683369.319306:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683369.319326:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f829e1000/0xcf8485587b889652 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88964b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.319357:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f829e1000/0xcf8485587b889652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88964b expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.319367:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f829e1000/0xcf8485587b889652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88964b expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.319377:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e1000, rc 0) 00000100:00100000:3.0:1789683369.319475:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850134272:12345-0@lo:101: Request processed in 193us (7387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683369.319490:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789683369.319664:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850134272:0@lo:101: 00010000:00010000:0.0:1789683369.319683:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbe00/0xcf8485587b88964b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889652 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.319693:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbe00/0xcf8485587b88964b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889652 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683369.319811:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850134400:0@lo:501: 00000100:00100000:0.0:1789683369.319850:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683369.319884:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f845d3300 going to sleep for 11 seconds 00000100:00100000:1.0:1789683369.319952:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850134400 00000100:00100000:1.0:1789683369.319957:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850134400 00000100:00100000:1.0:1789683369.319984:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789683369.319991:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850134400:12345-0@lo:501: 00000100:00100000:1.0:1789683369.320123:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850134400:12345-0@lo:501: Request processed in 132us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683369.320130:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789683369.320254:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850134400:0@lo:501: 00000100:00100000:0.0:1789683369.320282:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850134528:0@lo:503: 00000100:00100000:0.0:1789683369.320321:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683369.320341:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f845d3300 going to sleep for 11 seconds 00000100:00100000:3.0:1789683369.320490:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850134528 00000100:00100000:3.0:1789683369.320496:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850134528 00000100:00100000:3.0:1789683369.320532:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789683369.320539:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850134528:12345-0@lo:503: 00000100:00100000:3.0:1789683369.320620:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850134528:12345-0@lo:503: Request processed in 81us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683369.320627:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789683369.320664:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850134528:0@lo:503: 00000100:00100000:3.0:1789683369.321030:0:10362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10362:1876618850134656:0@lo:502: 00000100:00100000:3.0:1789683369.321067:0:10362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683369.321087:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850134656 00000100:00100000:3.0:1789683369.321098:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850134656 00000100:00100000:3.0:1789683369.321117:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789683369.321122:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:10362:x1876618850134656:12345-0@lo:502: 00000100:00100000:3.0:1789683369.321198:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:10362:x1876618850134656:12345-0@lo:502: Request processed in 75us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683369.321203:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789683369.321228:0:10362:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c490c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683369.321240:0:10362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10362:1876618850134656:0@lo:502: 00000100:00100000:3.0:1789683369.321271:0:10362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10362:1876618850134784:0@lo:502: 00000100:00100000:3.0:1789683369.321299:0:10362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683369.321314:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850134784 00000100:00100000:3.0:1789683369.321318:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850134784 00000100:00100000:3.0:1789683369.321335:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789683369.321341:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:10362:x1876618850134784:12345-0@lo:502: 00000100:00100000:3.0:1789683369.321394:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:10362:x1876618850134784:12345-0@lo:502: Request processed in 52us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683369.321400:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789683369.321426:0:10362:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92462600 going to sleep for 11 seconds 00000100:00100000:3.0:1789683369.321437:0:10362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10362:1876618850134784:0@lo:502: 00000040:00080000:3.0:1789683369.321454:0:10362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789683369.321516:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789683369.321533:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789683369.321542:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbe00/0xcf8485587b88964b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889652 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.321551:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbe00/0xcf8485587b88964b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889652 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683369.321570:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789683369.321573:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789683369.321576:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789683369.321597:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.321604:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.321613:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683369.321624:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850134912:0@lo:101: 00000100:00100000:3.0:1789683369.321649:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683369.321662:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c490c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683369.321675:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850134912 00000100:00100000:3.0:1789683369.321679:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850134912 00000100:00100000:3.0:1789683369.321696:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789683369.321702:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+16:6518:x1876618850134912:12345-0@lo:101: 00010000:00010000:3.0:1789683369.321710:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683369.321722:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f829e1800/0xcf8485587b889660 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889659 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.321741:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f829e1800/0xcf8485587b889660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889659 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.321751:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f829e1800/0xcf8485587b889660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889659 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.321773:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e1800, rc 0) 00000100:00100000:3.0:1789683369.321827:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850134912:12345-0@lo:101: Request processed in 125us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683369.321833:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789683369.321864:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850134912:0@lo:101: 00010000:00010000:3.0:1789683369.321875:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889659 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889660 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.321883:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889659 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889660 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683369.321920:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850135040:0@lo:501: 00000100:00100000:3.0:1789683369.321941:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683369.321953:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c490c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683369.321964:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850135040 00000100:00100000:3.0:1789683369.321967:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850135040 00000100:00100000:3.0:1789683369.321983:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789683369.321988:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850135040:12345-0@lo:501: 00000100:00100000:3.0:1789683369.322079:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850135040:12345-0@lo:501: Request processed in 89us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683369.322085:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789683369.322111:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850135040:0@lo:501: 00000100:00100000:3.0:1789683369.322131:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850135168:0@lo:503: 00000100:00100000:3.0:1789683369.322165:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683369.322179:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c490c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683369.322195:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850135168 00000100:00100000:3.0:1789683369.322216:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850135168 00000100:00100000:3.0:1789683369.322233:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789683369.322238:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850135168:12345-0@lo:503: 00000100:00100000:3.0:1789683369.322305:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850135168:12345-0@lo:503: Request processed in 66us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683369.322311:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789683369.322346:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850135168:0@lo:503: 00000100:00100000:3.0:1789683369.322566:0:10363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10363:1876618850135296:0@lo:502: 00000100:00100000:3.0:1789683369.322599:0:10363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683369.322616:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850135296 00000100:00100000:3.0:1789683369.322620:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850135296 00000100:00100000:3.0:1789683369.322638:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789683369.322644:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f93123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:10363:x1876618850135296:12345-0@lo:502: 00000100:00100000:3.0:1789683369.322702:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f93123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:10363:x1876618850135296:12345-0@lo:502: Request processed in 58us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683369.322708:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789683369.322735:0:10363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683369.322747:0:10363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10363:1876618850135296:0@lo:502: 00000020:01000000:3.0:1789683369.322765:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683369.322773:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683369.322775:0:10363:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789683369.322780:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789683369.322821:0:10363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10363:1876618850135424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683369.322854:0:10363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683369.322871:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850135424 00000100:00100000:3.0:1789683369.322874:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850135424 00000100:00100000:3.0:1789683369.322898:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789683369.322904:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:10363:x1876618850135424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683369.322959:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:10363:x1876618850135424:12345-0@lo:502:llog_process_th.0 Request processed in 55us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683369.322966:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789683369.322991:0:10363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683369.323004:0:10363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10363:1876618850135424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789683369.323021:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683369.323025:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683369.323026:0:10363:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789683369.323030:0:10363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1789683369.323067:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1789683369.323082:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789683369.323088:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889660 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.323096:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889660 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683369.323103:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789683369.323105:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0fb62ea800 from 48 10000000:01000000:3.0:1789683369.323108:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789683369.323125:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1a00/0xcf8485587b889667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.323133:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1a00/0xcf8485587b889667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.323141:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1a00/0xcf8485587b889667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683369.323163:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850135552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789683369.323187:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683369.323199:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683369.323211:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850135552 00000100:00100000:3.0:1789683369.323215:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850135552 00000100:00100000:3.0:1789683369.323232:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789683369.323237:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+17:6518:x1876618850135552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683369.323245:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683369.323255:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f829e0c00/0xcf8485587b88966e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889667 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.323271:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f829e0c00/0xcf8485587b88966e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889667 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.323280:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f829e0c00/0xcf8485587b88966e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889667 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.323287:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e0c00, rc 0) 00000100:00100000:3.0:1789683369.323315:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850135552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683369.323321:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789683369.323348:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850135552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683369.323357:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1a00/0xcf8485587b889667 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88966e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.323365:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1a00/0xcf8485587b889667 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88966e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683369.323409:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850135680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683369.323431:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683369.323443:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683369.323454:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850135680 00000100:00100000:3.0:1789683369.323457:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850135680 00000100:00100000:3.0:1789683369.323474:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789683369.332436:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc2073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850135680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683369.332647:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc2073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850135680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 9166us (9213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683369.332658:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789683369.333605:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850135680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683369.333675:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d14e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850135808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683369.333775:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683369.333841:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f84d923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683369.333929:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850135808 00000100:00100000:1.0:1789683369.333936:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850135808 00000100:00100000:1.0:1789683369.333994:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789683369.334004:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc2071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850135808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683369.334109:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc2071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:6518:x1876618850135808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683369.334117:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789683369.337633:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d14e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850135808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683369.338348:0:10364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83748380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10364:1876618850135936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683369.338442:0:10364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683369.338520:0:10364:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683369.339189:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850135936 00000100:00100000:0.0:1789683369.339198:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850135936 00000100:00100000:0.0:1789683369.339268:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789683369.339278:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:10364:x1876618850135936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683369.339437:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+18:10364:x1876618850135936:12345-0@lo:502:llog_process_th.0 Request processed in 159us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683369.339920:0:10364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83748380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10364:1876618850135936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683369.340259:0:10364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83748380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10364:1876618850136064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683369.340316:0:10364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683369.340350:0:10364:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683369.340404:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850136064 00000100:00100000:2.0:1789683369.340410:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850136064 00000100:00100000:2.0:1789683369.340454:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789683369.340462:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+19:10364:x1876618850136064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683369.340566:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+19:10364:x1876618850136064:12345-0@lo:502:llog_process_th.0 Request processed in 104us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683369.340573:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789683369.340750:0:10364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83748380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10364:1876618850136064:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789683369.340821:0:10364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789683369.341067:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789683369.341089:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789683369.341101:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1a00/0xcf8485587b889667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88966e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.341112:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1a00/0xcf8485587b889667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88966e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683369.341121:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789683369.341124:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789683369.341127:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789683369.341155:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.341176:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.341185:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683369.341201:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850136192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683369.341233:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683369.341256:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c5bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683369.341271:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850136192 00000100:00100000:2.0:1789683369.341275:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850136192 00000100:00100000:2.0:1789683369.341298:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789683369.341305:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+19:6518:x1876618850136192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683369.341315:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683369.341326:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f9e00/0xcf8485587b88967c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889675 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.341347:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f9e00/0xcf8485587b88967c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889675 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.341357:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f9e00/0xcf8485587b88967c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889675 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.341366:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f9e00, rc 0) 00000100:00100000:2.0:1789683369.341395:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850136192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683369.341401:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789683369.341441:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850136192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683369.341455:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889675 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88967c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.341464:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889675 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88967c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683369.341524:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850136320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683369.341549:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683369.341561:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c5bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683369.341572:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850136320 00000100:00100000:2.0:1789683369.341575:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850136320 00000100:00100000:2.0:1789683369.341594:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789683369.341600:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850136320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683369.341699:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850136320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683369.341705:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789683369.341733:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850136320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683369.341756:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850136448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683369.341827:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683369.341840:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c5bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683369.341850:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850136448 00000100:00100000:2.0:1789683369.341854:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850136448 00000100:00100000:2.0:1789683369.341872:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789683369.341877:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850136448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683369.342280:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789683369.356934:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850136448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683369.357395:0:10365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83748380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10365:1876618850136576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683369.357471:0:10365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683369.357524:0:10365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683369.357586:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850136576 00000100:00100000:0.0:1789683369.357595:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850136576 00000100:00100000:0.0:1789683369.357645:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789683369.357654:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:10365:x1876618850136576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683369.357836:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:10365:x1876618850136576:12345-0@lo:502:llog_process_th.0 Request processed in 182us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683369.357844:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789683369.358265:0:10365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83748380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10365:1876618850136576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789683369.358291:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683369.358300:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683369.358303:0:10365:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789683369.358307:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789683369.358331:0:10365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83748380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10365:1876618850136704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683369.358368:0:10365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683369.358386:0:10365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c5bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683369.358440:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850136704 00000100:00100000:0.0:1789683369.358446:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850136704 00000100:00100000:0.0:1789683369.358486:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789683369.358494:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:10365:x1876618850136704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683369.358568:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:10365:x1876618850136704:12345-0@lo:502:llog_process_th.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683369.358575:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789683369.358652:0:10365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83748380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10365:1876618850136704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789683369.358670:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683369.358674:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683369.358676:0:10365:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789683369.358679:0:10365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1789683369.358840:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789683369.358860:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789683369.358870:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88967c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.358881:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88967c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683369.358902:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789683369.358905:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0f88c59000 from 48 10000000:01000000:0.0:1789683369.358907:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789683369.358931:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b889683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.358949:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b889683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.358958:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b889683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683369.358971:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850136832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789683369.358999:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683369.359020:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f845d30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683369.359033:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850136832 00000100:00100000:0.0:1789683369.359037:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850136832 00000100:00100000:0.0:1789683369.359062:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789683369.359068:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850136832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683369.359076:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683369.359088:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f80031200/0xcf8485587b88968a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889683 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.359106:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f80031200/0xcf8485587b88968a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889683 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.359116:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f80031200/0xcf8485587b88968a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889683 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.359136:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f80031200, rc 0) 00000100:00100000:0.0:1789683369.359166:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850136832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683369.359172:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789683369.359198:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850136832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683369.359209:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b889683 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88968a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.359218:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b889683 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88968a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683369.359262:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850136960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683369.359283:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683369.359294:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f845d30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683369.359304:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850136960 00000100:00100000:0.0:1789683369.359307:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850136960 00000100:00100000:0.0:1789683369.359322:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789683369.359327:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850136960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683369.359424:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850136960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683369.359431:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789683369.359474:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850136960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683369.359509:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850137088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683369.359543:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683369.359562:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f845d30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683369.359572:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850137088 00000100:00100000:0.0:1789683369.359575:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850137088 00000100:00100000:0.0:1789683369.359591:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789683369.359596:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850137088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683369.359663:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850137088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683369.359670:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789683369.359700:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850137088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683369.360220:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850136448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 18340us (18390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683369.360234:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789683369.363853:0:10366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10366:1876618850137216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683369.363950:0:10366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683369.363982:0:10366:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e837203c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683369.364101:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850137216 00000100:00100000:0.0:1789683369.364110:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850137216 00000100:00100000:0.0:1789683369.364165:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789683369.364174:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:10366:x1876618850137216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683369.364303:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:10366:x1876618850137216:12345-0@lo:502:llog_process_th.0 Request processed in 129us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683369.364311:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789683369.364433:0:10366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10366:1876618850137216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683369.364505:0:10366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83748380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10366:1876618850137344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683369.364541:0:10366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683369.364566:0:10366:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683369.364875:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850137344 00000100:00100000:2.0:1789683369.364880:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850137344 00000100:00100000:2.0:1789683369.364902:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789683369.364908:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:10366:x1876618850137344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683369.365096:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:10366:x1876618850137344:12345-0@lo:502:llog_process_th.0 Request processed in 187us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683369.365103:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789683369.365174:0:10366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83748380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10366:1876618850137344:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789683369.365194:0:10366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789683369.365384:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789683369.365405:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789683369.365414:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b889683 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88968a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.365426:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b889683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88968a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683369.365437:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789683369.365439:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1789683369.365442:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789683369.365485:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b889691 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.365494:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b889691 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.365516:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b889691 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683369.365531:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850137472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683369.365558:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683369.365586:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683369.365676:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850137472 00000100:00100000:3.0:1789683369.365680:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850137472 00000100:00100000:3.0:1789683369.365712:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789683369.365718:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850137472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683369.365736:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683369.365748:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f829e0e00/0xcf8485587b889698 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889691 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.365769:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f829e0e00/0xcf8485587b889698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889691 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.365779:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f829e0e00/0xcf8485587b889698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889691 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.365826:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f829e0e00, rc 0) 00000100:00100000:3.0:1789683369.365855:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850137472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683369.365862:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789683369.366035:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850137472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683369.366048:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b889691 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889698 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.366058:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b889691 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889698 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683369.366104:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850137600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683369.366129:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683369.366157:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683369.366202:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850137600 00000100:00100000:3.0:1789683369.366208:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850137600 00000100:00100000:3.0:1789683369.366341:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789683369.366349:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850137600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683369.366466:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850137600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683369.366473:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789683369.366541:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850137600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683369.366566:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850137728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683369.366603:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683369.367090:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683369.367130:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850137728 00000100:00100000:0.0:1789683369.367136:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850137728 00000100:00100000:0.0:1789683369.367165:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789683369.367172:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850137728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683369.367271:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850137728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683369.367278:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789683369.367388:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850137728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683369.367869:0:10367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10367:1876618850137856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683369.367911:0:10367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683369.367936:0:10367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865eacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683369.368148:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850137856 00000100:00100000:0.0:1789683369.368153:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850137856 00000100:00100000:0.0:1789683369.368190:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789683369.368197:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:10367:x1876618850137856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683369.368309:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:10367:x1876618850137856:12345-0@lo:502:llog_process_th.0 Request processed in 111us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683369.368316:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789683369.368427:0:10367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10367:1876618850137856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789683369.368565:0:10367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683369.368582:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683369.368585:0:10367:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789683369.368592:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789683369.368615:0:10367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10367:1876618850137984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683369.368649:0:10367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683369.368678:0:10367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683369.368734:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850137984 00000100:00100000:0.0:1789683369.368738:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850137984 00000100:00100000:0.0:1789683369.368763:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789683369.368770:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:10367:x1876618850137984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683369.369076:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:10367:x1876618850137984:12345-0@lo:502:llog_process_th.0 Request processed in 305us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683369.369083:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789683369.369168:0:10367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10367:1876618850137984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789683369.369187:0:10367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683369.369192:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683369.369193:0:10367:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789683369.369197:0:10367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1789683369.369369:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1789683369.369390:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789683369.369400:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b889691 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889698 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.369410:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b889691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889698 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683369.369421:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789683369.369424:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0f8bdba800 from 48 10000000:01000000:0.0:1789683369.369426:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789683369.369451:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b88969f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.369459:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b88969f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.369469:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b88969f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683369.369507:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850138112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789683369.369536:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683369.369563:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f853943c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683369.369610:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850138112 00000100:00100000:1.0:1789683369.369615:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850138112 00000100:00100000:1.0:1789683369.369646:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789683369.369652:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850138112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683369.369661:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683369.369673:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837db800/0xcf8485587b8896a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88969f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.369694:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837db800/0xcf8485587b8896a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88969f expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.369711:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837db800/0xcf8485587b8896a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88969f expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.369720:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837db800, rc 0) 00000100:00100000:1.0:1789683369.369756:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850138112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683369.369762:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789683369.369872:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850138112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683369.369884:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b88969f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.369893:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b88969f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8896a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683369.369952:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850138240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683369.369980:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683369.369995:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683369.370007:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850138240 00000100:00100000:2.0:1789683369.370011:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850138240 00000100:00100000:2.0:1789683369.370029:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789683369.370035:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850138240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683369.370130:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850138240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683369.370137:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789683369.370172:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850138240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683369.370193:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850138368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683369.370223:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683369.370234:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683369.370244:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850138368 00000100:00100000:2.0:1789683369.370247:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850138368 00000100:00100000:2.0:1789683369.370261:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789683369.370266:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850138368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683369.370327:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850138368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683369.370334:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789683369.370370:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850138368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683369.371172:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10368:1876618850138496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683369.371215:0:10368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683369.371274:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865ea480 going to sleep for 11 seconds 00000100:00100000:2.0:1789683369.371394:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850138496 00000100:00100000:2.0:1789683369.371400:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850138496 00000100:00100000:2.0:1789683369.371429:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789683369.371435:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:10368:x1876618850138496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683369.371569:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:10368:x1876618850138496:12345-0@lo:502:llog_process_th.0 Request processed in 133us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683369.371577:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789683369.371770:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10368:1876618850138496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683369.371831:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10368:1876618850138624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683369.371860:0:10368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683369.371874:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865ea480 going to sleep for 11 seconds 00000100:00100000:2.0:1789683369.371922:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850138624 00000100:00100000:2.0:1789683369.371927:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850138624 00000100:00100000:2.0:1789683369.372059:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789683369.372067:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:10368:x1876618850138624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683369.372133:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:10368:x1876618850138624:12345-0@lo:502:llog_process_th.0 Request processed in 66us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683369.372149:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789683369.372200:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10368:1876618850138624:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789683369.372216:0:10368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789683369.372415:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789683369.372433:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789683369.372442:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b88969f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.372454:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b88969f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683369.372463:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789683369.372465:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1789683369.372468:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789683369.372502:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b8896ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.372510:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b8896ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.372519:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b8896ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683369.372532:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850138752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683369.372556:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683369.372616:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e837203c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683369.372645:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850138752 00000100:00100000:0.0:1789683369.372649:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850138752 00000100:00100000:0.0:1789683369.372704:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789683369.372712:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850138752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683369.372720:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683369.372731:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f80031c00/0xcf8485587b8896b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8896ad expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.372749:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f80031c00/0xcf8485587b8896b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8896ad expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.372760:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f80031c00/0xcf8485587b8896b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8896ad expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.372769:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f80031c00, rc 0) 00000100:00100000:0.0:1789683369.372928:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850138752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 217us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683369.372935:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789683369.373027:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850138752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683369.373039:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b8896ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.373049:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b8896ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8896b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683369.373092:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850138880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683369.373124:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683369.373218:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865ea480 going to sleep for 11 seconds 00000100:00100000:1.0:1789683369.373350:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850138880 00000100:00100000:1.0:1789683369.373355:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850138880 00000100:00100000:1.0:1789683369.373372:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789683369.373377:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850138880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683369.373474:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850138880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683369.373492:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789683369.373561:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850138880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683369.373589:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850139008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683369.373631:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683369.373653:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f853943c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683369.373699:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850139008 00000100:00100000:1.0:1789683369.373703:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850139008 00000100:00100000:1.0:1789683369.373721:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789683369.373726:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850139008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683369.373835:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850139008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683369.373843:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789683369.373925:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850139008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683369.374329:0:10369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10369:1876618850139136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683369.374364:0:10369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683369.374392:0:10369:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88102240 going to sleep for 11 seconds 00000100:00100000:1.0:1789683369.374437:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850139136 00000100:00100000:1.0:1789683369.374442:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850139136 00000100:00100000:1.0:1789683369.374475:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789683369.374492:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:10369:x1876618850139136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683369.374578:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:10369:x1876618850139136:12345-0@lo:502:llog_process_th.0 Request processed in 86us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683369.374585:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789683369.374968:0:10369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10369:1876618850139136:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789683369.374991:0:10369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683369.375000:0:10369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683369.375002:0:10369:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789683369.375006:0:10369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789683369.375027:0:10369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10369:1876618850139264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683369.375060:0:10369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683369.375088:0:10369:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88102240 going to sleep for 11 seconds 00000100:00100000:1.0:1789683369.375189:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850139264 00000100:00100000:1.0:1789683369.375195:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850139264 00000100:00100000:1.0:1789683369.375217:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789683369.375223:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:10369:x1876618850139264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683369.375303:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:10369:x1876618850139264:12345-0@lo:502:llog_process_th.0 Request processed in 80us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683369.375310:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789683369.375379:0:10369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10369:1876618850139264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789683369.375397:0:10369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683369.375401:0:10369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683369.375403:0:10369:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789683369.375406:0:10369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789683369.375684:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1789683369.375706:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789683369.375717:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b8896ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.375729:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b8896ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683369.375739:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789683369.375741:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f0fa508b380 from 1 10000000:01000000:1.0:1789683369.375745:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789683369.375769:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837da600/0xcf8485587b8896bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.375777:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0e837da600/0xcf8485587b8896bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.376123:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0e837da600/0xcf8485587b8896bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683369.376142:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850139392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789683369.376183:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683369.376209:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865eab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683369.376253:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850139392 00000100:00100000:0.0:1789683369.376259:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850139392 00000100:00100000:0.0:1789683369.376297:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789683369.376306:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850139392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683369.376317:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683369.376349:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454c400/0xcf8485587b8896c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8896bb expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.376372:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454c400/0xcf8485587b8896c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8896bb expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.376395:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454c400/0xcf8485587b8896c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8896bb expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.376404:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454c400, rc 0) 00000100:00100000:0.0:1789683369.376441:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850139392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683369.376447:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789683369.376498:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850139392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683369.376511:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0e837da600/0xcf8485587b8896bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896c2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.376520:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0e837da600/0xcf8485587b8896bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8896c2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683369.376571:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850139520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683369.376597:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683369.376611:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88102900 going to sleep for 11 seconds 00000100:00100000:0.0:1789683369.376623:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850139520 00000100:00100000:0.0:1789683369.376627:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850139520 00000100:00100000:0.0:1789683369.376643:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789683369.376649:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850139520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683369.376717:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850139520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 67us (119us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789683369.376724:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789683369.376752:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850139520:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789683369.376807:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789683369.376814:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837da600/0xcf8485587b8896bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896c2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.376821:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0e837da600/0xcf8485587b8896bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896c2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683369.567992:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683369.568013:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850139648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683369.568080:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683369.568175:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850139648 00000100:00100000:1.0:1789683369.568183:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850139648 00000100:00100000:1.0:1789683369.568251:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789683369.568270:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8374a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850139648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683369.568294:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683369.568342:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8374a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850139648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683369.568348:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789683369.568391:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83748380 x1876618850139648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683369.568409:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850139648:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789683369.568458:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683369.568601:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850139776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683369.568632:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683369.569059:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850139776 00000100:00100000:0.0:1789683369.569066:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850139776 00000100:00100000:0.0:1789683369.569100:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789683369.569108:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850139776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789683369.569140:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789683369.569181:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850139776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683369.569187:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789683369.569261:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850139776:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1789683369.860686:0:10399:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffdbfb96f0 20000000:00000080:1.0:1789683369.860706:0:10399:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0e83c86c00 uarg=0000000000000000 20000000:01000000:1.0:1789683369.860750:0:10399:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789683369.860756:0:10399:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789683369.860761:0:10399:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789683369.861680:0:10400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789683369.861885:0:10399:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789683369.867430:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789683369.867480:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789683369.867500:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789683369.867573:0:10399:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789683369.867597:0:10399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0e837db400/0xcf8485587b8896c9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.867615:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f829e1200/0xcf8485587b889365 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88935e expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.867622:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f829e1e00/0xcf8485587b889373 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88936c expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.867628:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f829e0a00/0xcf8485587b8893c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8893c0 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.867653:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f81390a00/0xcf8485587b8894ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8894e6 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.867701:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f80031400/0xcf8485587b889605 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc402 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.868216:0:10399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0e837db400/0xcf8485587b8896c9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.868889:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f80031400/0xcf8485587b889605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc402 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.868905:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0f80031400/0xcf8485587b889605 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc402 expref: 9 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683369.868921:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876618850139904:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789683369.869434:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f81390a00/0xcf8485587b8894ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b8894e6 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.869443:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f81390a00/0xcf8485587b8894ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b8894e6 expref: 23 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683369.869452:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876618850140032:0@lo:104: 00000100:00100000:1.0:1789683369.869500:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683369.869544:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f829e0a00/0xcf8485587b8893c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b8893c0 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.869552:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f829e0a00/0xcf8485587b8893c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b8893c0 expref: 23 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683369.869572:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876618850140160:0@lo:104: 00000100:00100000:1.0:1789683369.870085:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683369.870120:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f829e1e00/0xcf8485587b889373 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88936c expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.870129:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f829e1e00/0xcf8485587b889373 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88936c expref: 23 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683369.870138:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876618850140288:0@lo:104: 00010000:00010000:1.0:1789683369.870164:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f829e1200/0xcf8485587b889365 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88935e expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.870172:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f829e1200/0xcf8485587b889365 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88935e expref: 23 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683369.870180:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876618850140416:0@lo:104: 00000100:00100000:1.0:1789683369.870199:0:10399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865ea3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683369.870329:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789683369.870362:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683369.870376:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683369.870385:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850140032 00000100:00100000:3.0:1789683369.870392:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850140032 00000100:00100000:3.0:1789683369.870430:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850140160 00000100:00100000:3.0:1789683369.870433:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850140160 00000100:00100000:3.0:1789683369.870441:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850140288 00000100:00100000:3.0:1789683369.870444:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850140288 00000100:00100000:3.0:1789683369.870451:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850140416 00000100:00100000:3.0:1789683369.870453:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850140416 00000100:00100000:3.0:1789683369.870464:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789683369.870483:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+6:10399:x1876618850140032:12345-0@lo:104: 00010000:00010000:3.0:1789683369.870496:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f81391a00/0xcf8485587b8894e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8894ed expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.870568:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789683369.870574:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+6:10399:x1876618850140032:12345-0@lo:104: Request processed in 94us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683369.870581:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789683369.870598:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789683369.870604:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:10399:x1876618850140160:12345-0@lo:104: 00010000:00010000:3.0:1789683369.870612:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b8893c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8893c7 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.870645:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789683369.870649:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:10399:x1876618850140160:12345-0@lo:104: Request processed in 46us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683369.870664:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789683369.870693:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789683369.870700:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83749500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:10399:x1876618850140288:12345-0@lo:104: 00010000:00010000:3.0:1789683369.870707:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0400/0xcf8485587b88936c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889373 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.870842:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789683369.870850:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f81391a00/0xcf8485587b8894e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8894ed expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.870857:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81391a00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683369.870861:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81391a00/0xcf8485587b8894e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8894ed expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.870870:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f81391a00/0xcf8485587b8894e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8894ed expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683369.870877:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81391a00/0xcf8485587b8894e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8894ed expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683369.870894:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789683369.870924:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f81391a00/0xcf8485587b8894e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8894ed expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.870931:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683369.870950:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f81391a00/0xcf8485587b8894e6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8894ed expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.870956:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f81391a00/0xcf8485587b8894e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8894ed expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.870969:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683369.870972:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b8893c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8893c7 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.870977:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9600 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683369.870979:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b8893c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8893c7 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.870997:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b8893c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8893c7 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683369.871004:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b8893c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8893c7 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683369.871009:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789683369.871022:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b8893c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8893c7 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.871028:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683369.871041:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b8893c0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8893c7 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.871046:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b8893c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8893c7 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.871055:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683369.871058:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0400/0xcf8485587b88936c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889373 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.871063:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f829e0400 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683369.871065:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0400/0xcf8485587b88936c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b889373 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.871071:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0400/0xcf8485587b88936c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b889373 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683369.871076:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0400/0xcf8485587b88936c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b889373 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683369.871081:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789683369.871093:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0400/0xcf8485587b88936c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889373 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.871098:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683369.871113:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0400/0xcf8485587b88936c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889373 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.871119:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f829e0400/0xcf8485587b88936c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889373 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.871128:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683369.871136:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683369.871138:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683369.871160:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850140800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683369.871194:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683369.871229:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850140800 00000100:00100000:0.0:1789683369.871234:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850140800 00010000:00010000:0.0:1789683369.871255:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f829e1e00/0xcf8485587b889373 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88936c expref: 24 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683369.871278:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789683369.871284:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0709c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850140800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683369.871294:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683369.871299:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f829e1e00/0xcf8485587b889373 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88936c expref: 24 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.871309:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f829e1e00/0xcf8485587b889373 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88936c expref: 24 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.871323:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683369.871366:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0709c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850140800:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683369.871372:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789683369.871409:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850140800:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683369.875277:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683369.875311:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850140544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683369.875401:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683369.875498:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683369.875518:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850140672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683369.875549:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683369.875589:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850140544 00000100:00100000:2.0:1789683369.875597:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850140544 00010000:00010000:2.0:1789683369.875631:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f81390a00/0xcf8485587b8894ed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8894e6 expref: 24 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683369.875661:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850140672 00000100:00100000:2.0:1789683369.875664:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850140672 00010000:00010000:2.0:1789683369.875675:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f829e0a00/0xcf8485587b8893c7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8893c0 expref: 25 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683369.875696:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789683369.875705:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e97b3c51-c653-4f2f-8e95-54cfcf70f127+25:3649:x1876618850140544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683369.875718:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683369.875723:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f81390a00/0xcf8485587b8894ed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8894e6 expref: 25 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.875735:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f81390a00/0xcf8485587b8894ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b8894e6 expref: 25 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.875756:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683369.875814:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e97b3c51-c653-4f2f-8e95-54cfcf70f127+25:3649:x1876618850140544:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683369.875821:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789683369.875840:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789683369.875846:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3649:x1876618850140672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683369.875853:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683369.875857:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f829e0a00/0xcf8485587b8893c7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8893c0 expref: 24 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.875870:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f829e0a00/0xcf8485587b8893c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b8893c0 expref: 24 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.875879:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683369.875901:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3649:x1876618850140672:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683369.875906:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789683369.876043:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850140672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683369.876051:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850140544:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683369.876756:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81390a00/0xcf8485587b8894ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b8894e6 expref: 23 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683369.876772:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876618850140032:0@lo:104: 00010000:00010000:1.0:1789683369.876801:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f829e0a00/0xcf8485587b8893c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b8893c0 expref: 22 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683369.876810:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876618850140160:0@lo:104: 00010000:00010000:1.0:1789683369.876822:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f829e1e00/0xcf8485587b889373 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88936c expref: 21 pid: 6515 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683369.876845:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876618850140288:0@lo:104: 00010000:00010000:2.0:1789683369.877828:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683369.878127:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876618850139904:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789683369.878660:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789683369.878671:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83749500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:10399:x1876618850140288:12345-0@lo:104: Request processed in 7970us (8307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683369.878682:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789683369.878930:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683369.879110:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835401088 00000100:00100000:1.0:1789683369.879118:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835401088 00010000:00010000:1.0:1789683369.879150:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f80031400/0xcf8485587b889605 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc402 expref: 10 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683369.879180:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 38 00000100:00100000:1.0:1789683369.879188:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb29fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea7031b9-febc-4826-a965-62f420153ef7+10:2403:x1876618835401088:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683369.879202:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683369.879208:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f80031400/0xcf8485587b889605 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc402 expref: 10 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.879221:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f80031400/0xcf8485587b889605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc402 expref: 10 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.879238:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f80031400/0xcf8485587b889605 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc402 expref: 10 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.879271:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683369.879335:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb29fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea7031b9-febc-4826-a965-62f420153ef7+9:2403:x1876618835401088:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 147us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683369.879342:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 38 00000100:00100000:3.0:1789683369.879808:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789683369.879819:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8374a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:10399:x1876618850140416:12345-0@lo:104: 00010000:00010000:3.0:1789683369.879831:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f80030000/0xcf8485587b88935e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889365 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683369.879889:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789683369.879895:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8374a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:10399:x1876618850140416:12345-0@lo:104: Request processed in 79us (9518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683369.879901:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789683369.880109:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1876618850140416:0@lo:104: 00010000:00010000:2.0:1789683369.880140:0:10399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0e837db400/0xcf8485587b8896c9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.880213:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683369.880220:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f80030000/0xcf8485587b88935e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889365 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.880227:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f80030000 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683369.880774:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80030000/0xcf8485587b88935e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b889365 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.880831:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f80030000/0xcf8485587b88935e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b889365 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683369.880839:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80030000/0xcf8485587b88935e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b889365 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683369.880845:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789683369.880879:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f80030000/0xcf8485587b88935e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889365 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.880886:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683369.880913:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f80030000/0xcf8485587b88935e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889365 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.880920:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f80030000/0xcf8485587b88935e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889365 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683369.880937:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683369.880939:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683369.880941:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683369.881168:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850140928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683369.881221:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683369.883161:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850140928 00000100:00100000:2.0:1789683369.883177:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850140928 00010000:00010000:0.0:1789683369.883602:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f829e1200/0xcf8485587b889365 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88935e expref: 21 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683369.883682:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789683369.883692:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:3648:x1876618850140928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683369.883724:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683369.883729:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f829e1200/0xcf8485587b889365 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88935e expref: 21 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.883742:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f829e1200/0xcf8485587b889365 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88935e expref: 21 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.883760:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f829e1200/0xcf8485587b889365 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88935e expref: 21 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.883777:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0e837db400/0xcf8485587b8896c9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.883824:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837db400/0xcf8485587b8896c9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.883842:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0e837db400/0xcf8485587b8896c9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.883849:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0e837db400/0xcf8485587b8896c9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.883856:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0e837db400/0xcf8485587b8896c9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.883862:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0e837db400/0xcf8485587b8896c9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.883868:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837db400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683369.883872:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0e837db400/0xcf8485587b8896c9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.883890:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0e837db400/0xcf8485587b8896c9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.883902:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0e837db400/0xcf8485587b8896c9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683369.883914:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683369.884004:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:3648:x1876618850140928:12345-0@lo:103:ldlm_bl.0 Request processed in 314us (2783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683369.884012:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789683369.884098:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850140928:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683369.884300:0:10399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0e837db400/0xcf8485587b8896c9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.884308:0:10399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0e837db400/0xcf8485587b8896c9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683369.884314:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837db400/0xcf8485587b8896c9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683370.017475:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683370.206123:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683370.206300:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835401216 00000100:00100000:0.0:1789683370.206319:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835401216 00000100:00100000:0.0:1789683370.206396:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 254 00000100:00100000:0.0:1789683370.206407:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+9:6175:x1876618835401216:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683370.206426:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683370.206448:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454ce00/0xcf8485587b8896d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc448 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683370.206521:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454ce00/0xcf8485587b8896d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc448 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683370.206534:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454ce00/0xcf8485587b8896d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc448 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683370.206544:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454ce00, rc 0) 00000100:00100000:0.0:1789683370.206632:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+10:6175:x1876618835401216:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 Request processed in 226us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683370.206638:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 254 00000100:00100000:0.0:1789683370.222561:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683370.222866:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835401344 00000100:00100000:3.0:1789683370.222878:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835401344 00000100:00100000:3.0:1789683370.223019:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 255 00000100:00100000:3.0:1789683370.223032:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+10:6175:x1876618835401344:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683370.223265:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+10:6175:x1876618835401344:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 Request processed in 236us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683370.223288:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 255 00000100:00100000:2.0:1789683370.232430:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683370.234411:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835401472 00000100:00100000:0.0:1789683370.234425:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835401472 00000100:00100000:0.0:1789683370.234517:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 256 00000100:00100000:0.0:1789683370.234529:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+10:6175:x1876618835401472:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683370.234699:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+10:6175:x1876618835401472:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 Request processed in 171us (2277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683370.234708:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 256 00000100:00100000:2.0:1789683370.238989:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683370.239356:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835401600 00000100:00100000:1.0:1789683370.239368:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835401600 00000100:00100000:1.0:1789683370.239424:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 257 00000100:00100000:1.0:1789683370.239434:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+10:6701:x1876618835401600:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789683370.239606:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+10:6701:x1876618835401600:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 173us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683370.239621:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 257 00000100:00100000:1.0:1789683370.244738:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683370.244916:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835401728 00000100:00100000:3.0:1789683370.244928:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835401728 00000100:00100000:3.0:1789683370.244982:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 258 00000100:00100000:3.0:1789683370.244992:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+10:6701:x1876618835401728:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789683370.245150:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+10:6701:x1876618835401728:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 159us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683370.245158:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 258 10000000:01000000:0.0:1789683370.917025:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789683370.917034:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0e827aa000 from 4 10000000:01000000:0.0:1789683370.917040:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789683370.917086:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454cc00/0xcf8485587b8896d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683370.917099:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f8454cc00/0xcf8485587b8896d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683370.917111:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f8454cc00/0xcf8485587b8896d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683370.917140:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850141056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789683370.917210:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683370.917315:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa3180 going to sleep for 11 seconds 00000100:00100000:1.0:1789683370.919422:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850141056 00000100:00100000:1.0:1789683370.919435:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850141056 00000100:00100000:1.0:1789683370.919508:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789683370.919519:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850141056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683370.919536:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683370.919552:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837da200/0xcf8485587b8896de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8896d7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683370.919580:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837da200/0xcf8485587b8896de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8896d7 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683370.919592:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837da200/0xcf8485587b8896de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8896d7 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683370.919603:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da200, rc 0) 00000100:00100000:1.0:1789683370.919682:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850141056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (2472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683370.919689:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789683370.919833:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850141056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683370.919853:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f8454cc00/0xcf8485587b8896d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683370.919862:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f8454cc00/0xcf8485587b8896d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8896de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683370.919946:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850141184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683370.919994:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683370.920021:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850141184 00000100:00100000:0.0:1789683370.920025:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850141184 00000100:00100000:0.0:1789683370.920048:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789683370.920054:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850141184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683370.920154:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850141184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683370.920160:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789683370.920189:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa3180 going to sleep for 11 seconds 00000100:00100000:0.0:1789683370.920463:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850141184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683370.920494:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850141312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683370.920535:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683370.920555:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850141312 00000100:00100000:0.0:1789683370.920559:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850141312 00000100:00100000:0.0:1789683370.920581:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789683370.920587:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850141312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683370.920655:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850141312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683370.920664:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789683370.920695:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa3180 going to sleep for 11 seconds 00000100:00100000:0.0:1789683370.920706:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850141312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683370.921015:0:10439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10439:1876618850141440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683370.921056:0:10439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683370.921077:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850141440 00000100:00100000:0.0:1789683370.921081:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850141440 00000100:00100000:0.0:1789683370.921105:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789683370.921110:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:10439:x1876618850141440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683370.921188:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:10439:x1876618850141440:12345-0@lo:502:llog_process_th.0 Request processed in 77us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683370.921195:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789683370.921225:0:10439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683370.921237:0:10439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10439:1876618850141440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789683370.921257:0:10439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683370.921267:0:10439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683370.921269:0:10439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789683370.921279:0:10439:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0e827aa000 00000020:00000080:0.0:1789683370.921281:0:10439:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789683370.922125:0:10439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10439:1876618850141568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683370.922176:0:10439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683370.922194:0:10439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683370.922219:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850141568 00000100:00100000:1.0:1789683370.922224:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850141568 00000100:00100000:1.0:1789683370.922253:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789683370.922260:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:10439:x1876618850141568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683370.922352:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:10439:x1876618850141568:12345-0@lo:502:llog_process_th.0 Request processed in 92us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683370.922359:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789683370.922404:0:10439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10439:1876618850141568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789683370.922424:0:10439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683370.922429:0:10439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683370.922432:0:10439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789683370.922439:0:10439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789683370.922579:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789683370.922597:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789683370.922606:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454cc00/0xcf8485587b8896d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683370.922618:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f8454cc00/0xcf8485587b8896d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683370.922627:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789683370.922630:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0fb62ea800 from 4 10000000:01000000:1.0:1789683370.922633:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789683370.922655:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbc00/0xcf8485587b8896e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683370.922662:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbc00/0xcf8485587b8896e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683370.922671:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbc00/0xcf8485587b8896e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683370.922684:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850141696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789683370.922722:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683370.922736:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683370.922749:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850141696 00000100:00100000:1.0:1789683370.922753:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850141696 00000100:00100000:1.0:1789683370.922773:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789683370.922779:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850141696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683370.922914:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683370.922927:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837da400/0xcf8485587b8896ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8896e5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683370.923031:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837da400/0xcf8485587b8896ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8896e5 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683370.923045:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837da400/0xcf8485587b8896ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8896e5 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683370.923054:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da400, rc 0) 00000100:00100000:1.0:1789683370.923088:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850141696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 309us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683370.923094:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789683370.923140:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850141696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683370.923152:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbc00/0xcf8485587b8896e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683370.923161:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbc00/0xcf8485587b8896e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8896ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683370.923210:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850141824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683370.923244:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683370.923258:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683370.923270:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850141824 00000100:00100000:1.0:1789683370.923274:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850141824 00000100:00100000:1.0:1789683370.923293:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789683370.923299:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850141824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683370.923388:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850141824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683370.923395:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789683370.923425:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850141824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683370.923459:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850141952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683370.923494:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683370.923508:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683370.923518:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850141952 00000100:00100000:1.0:1789683370.923521:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850141952 00000100:00100000:1.0:1789683370.923541:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789683370.923547:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850141952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683370.923614:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850141952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683370.923621:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789683370.923661:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850141952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683370.923864:0:10440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10440:1876618850142080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683370.923894:0:10440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683370.923910:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850142080 00000100:00100000:1.0:1789683370.923918:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850142080 00000100:00100000:1.0:1789683370.923938:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789683370.923944:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:10440:x1876618850142080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683370.924185:0:10440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683370.928858:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:10440:x1876618850142080:12345-0@lo:502:llog_process_th.0 Request processed in 4907us (4957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683370.928871:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789683370.929827:0:10440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10440:1876618850142080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789683370.929864:0:10440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683370.929875:0:10440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683370.929877:0:10440:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789683370.929885:0:10440:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0fb62ea800 00000020:00000080:2.0:1789683370.929888:0:10440:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789683370.929974:0:10440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10440:1876618850142208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683370.930026:0:10440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683370.930058:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850142208 00000100:00100000:2.0:1789683370.930065:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850142208 00000100:00100000:2.0:1789683370.930103:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789683370.930111:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:10440:x1876618850142208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683370.930207:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:10440:x1876618850142208:12345-0@lo:502:llog_process_th.0 Request processed in 96us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683370.930215:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789683370.930262:0:10440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683370.930274:0:10440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10440:1876618850142208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789683370.930292:0:10440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683370.930296:0:10440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683370.930297:0:10440:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789683370.930300:0:10440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789683370.933152:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789683370.933199:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683370.933214:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbc00/0xcf8485587b8896e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683370.933227:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbc00/0xcf8485587b8896e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683370.933239:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789683370.933241:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0f88c59000 from 4 10000000:01000000:2.0:1789683370.933245:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683370.933282:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8896f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683370.933291:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8896f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683370.933301:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8896f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683370.933326:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850142336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683370.933390:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683370.933427:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683370.933479:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850142336 00000100:00100000:2.0:1789683370.933487:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850142336 00000100:00100000:2.0:1789683370.933531:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789683370.933540:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850142336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683370.933553:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683370.933566:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b8896fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8896f3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683370.933600:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b8896fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8896f3 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683370.933610:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b8896fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8896f3 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683370.933618:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f9600, rc 0) 00000100:00100000:2.0:1789683370.933655:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850142336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683370.933662:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789683370.933711:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850142336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683370.933724:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8896f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683370.933732:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8896f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8896fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683370.933805:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850142464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683370.933830:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683370.933849:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683370.933861:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850142464 00000100:00100000:2.0:1789683370.933864:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850142464 00000100:00100000:2.0:1789683370.933888:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789683370.933894:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850142464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683370.934080:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850142464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683370.934095:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789683370.934124:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850142464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683370.934151:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850142592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683370.934190:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683370.934207:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683370.934219:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850142592 00000100:00100000:2.0:1789683370.934223:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850142592 00000100:00100000:2.0:1789683370.934243:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789683370.934248:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850142592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683370.934326:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850142592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683370.934333:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789683370.934372:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850142592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683370.934556:0:10443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10443:1876618850142720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683370.934590:0:10443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683370.934609:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850142720 00000100:00100000:2.0:1789683370.934612:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850142720 00000100:00100000:2.0:1789683370.934634:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789683370.934639:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:10443:x1876618850142720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683370.934702:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:10443:x1876618850142720:12345-0@lo:502:llog_process_th.0 Request processed in 61us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683370.934708:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789683370.934735:0:10443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83720300 going to sleep for 11 seconds 00000100:00100000:2.0:1789683370.934747:0:10443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10443:1876618850142720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789683370.934771:0:10443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683370.934810:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683370.934813:0:10443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789683370.934821:0:10443:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0f88c59000 00000020:00000080:2.0:1789683370.934823:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789683370.934894:0:10443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10443:1876618850142848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683370.934926:0:10443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683370.934945:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850142848 00000100:00100000:1.0:1789683370.935860:0:10443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f845d3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683370.938297:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850142848 00000100:00100000:2.0:1789683370.938354:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789683370.938366:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:10443:x1876618850142848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683370.938533:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:10443:x1876618850142848:12345-0@lo:502:llog_process_th.0 Request processed in 170us (3604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683370.938540:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789683370.943669:0:10443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10443:1876618850142848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789683370.943713:0:10443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683370.943722:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683370.943725:0:10443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789683370.943734:0:10443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789683370.947920:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789683370.948022:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789683370.948034:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8896f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683370.948048:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8896f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683370.948059:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789683370.948062:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0f8bdba800 from 4 10000000:01000000:3.0:1789683370.948064:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789683370.948101:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b889701 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683370.948110:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b889701 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683370.948133:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b889701 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683370.948172:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83748700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850142976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789683370.948236:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683370.948475:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9054ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683370.952945:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850142976 00000100:00100000:1.0:1789683370.953110:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850142976 00000100:00100000:1.0:1789683370.953240:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789683370.953251:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850142976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683370.953271:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683370.953293:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837da800/0xcf8485587b889708 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889701 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683370.953327:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837da800/0xcf8485587b889708 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889701 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683370.953351:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837da800/0xcf8485587b889708 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889701 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683370.953362:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da800, rc 0) 00000100:00100000:1.0:1789683370.953467:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850142976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (5230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683370.953483:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789683370.953566:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83748700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850142976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683370.953587:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b889701 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889708 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683370.953597:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b889701 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889708 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683370.953686:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850143104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683370.953721:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683370.953861:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f845d3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683370.953881:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850143104 00000100:00100000:1.0:1789683370.953885:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850143104 00000100:00100000:0.0:1789683370.954085:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789683370.954095:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850143104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683370.954268:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850143104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683370.954275:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789683370.955108:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850143104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683370.955294:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850143232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683370.955351:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683370.955370:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f845d3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683370.955390:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850143232 00000100:00100000:1.0:1789683370.955395:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850143232 00000100:00100000:1.0:1789683370.955427:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789683370.955434:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850143232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683370.955540:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850143232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683370.955547:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789683370.955590:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850143232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683370.957446:0:10446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10446:1876618850143360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683370.957535:0:10446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683370.957573:0:10446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683370.957870:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850143360 00000100:00100000:1.0:1789683370.957878:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850143360 00000100:00100000:1.0:1789683370.957931:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789683370.957940:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:10446:x1876618850143360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683370.958333:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:10446:x1876618850143360:12345-0@lo:502:llog_process_th.0 Request processed in 393us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683370.958341:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1789683370.959232:0:10446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10446:1876618850143360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789683370.959272:0:10446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683370.959287:0:10446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683370.959290:0:10446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789683370.959302:0:10446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0f8bdba800 00000020:00000080:0.0:1789683370.959305:0:10446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789683370.959677:0:10446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10446:1876618850143488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683370.959731:0:10446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683370.959758:0:10446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683370.961094:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850143488 00000100:00100000:1.0:1789683370.961106:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850143488 00000100:00100000:1.0:1789683370.961153:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789683370.961163:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:10446:x1876618850143488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683370.961296:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:10446:x1876618850143488:12345-0@lo:502:llog_process_th.0 Request processed in 133us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683370.961304:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789683370.961869:0:10446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:10446:1876618850143488:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789683370.961904:0:10446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683370.962849:0:10446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683370.962855:0:10446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789683370.962863:0:10446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789683370.963084:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789683370.963109:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789683370.963120:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b889701 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889708 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683370.963132:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b889701 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889708 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.040171:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683371.109117:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850143616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683371.109183:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683371.115285:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850143616 00000100:00100000:3.0:1789683371.115301:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850143616 00000100:00100000:1.0:1789683371.115544:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789683371.115556:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850143616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789683371.115590:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683371.115677:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850143616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (6494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683371.115700:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789683371.115724:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789683371.115765:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0708a80 x1876618850143616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683371.115816:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850143616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683371.616082:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850143744:0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.616169:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683371.616216:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850144256:0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.616238:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683371.616257:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850144768:0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.616275:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683371.616295:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789683371.616301:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850144128:0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.616321:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683371.616350:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850144640:0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.616369:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683371.616408:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850143872:0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.616428:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683371.616455:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850144384:0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.616473:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683371.616486:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1876618850144896:0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.616503:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683371.616513:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789683371.616525:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850144000:0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.616544:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683371.616553:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850144512:0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.616568:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683371.616587:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850145024:0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.616603:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683371.616633:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850143744 00000100:00100000:1.0:1789683371.616640:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850143744 00000100:00100000:1.0:1789683371.616679:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850144256 00000100:00100000:1.0:1789683371.616682:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850144256 00000100:00100000:1.0:1789683371.616702:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850144768 00000100:00100000:1.0:1789683371.616704:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850144768 00000100:00100000:1.0:1789683371.616713:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850144384 00000100:00100000:1.0:1789683371.616715:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850144384 00000100:00100000:1.0:1789683371.616724:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850144896 00000100:00100000:1.0:1789683371.616726:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850144896 00000100:00100000:1.0:1789683371.616736:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850144000 00000100:00100000:1.0:1789683371.616738:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850144000 00000100:00100000:1.0:1789683371.616750:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789683371.616758:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850143744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.616827:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850143744:12345-0@lo:400:kworker.0 Request processed in 69us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683371.616835:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789683371.616852:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789683371.616858:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850144256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.616883:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850144256:12345-0@lo:400:kworker.0 Request processed in 25us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683371.616888:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789683371.616905:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789683371.616910:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850144768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.616933:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850144768:12345-0@lo:400:kworker.0 Request processed in 24us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683371.616939:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789683371.616949:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789683371.616954:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850144384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.616984:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850144384:12345-0@lo:400:kworker.0 Request processed in 31us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683371.616989:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789683371.617000:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789683371.617006:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876618850144896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.617032:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876618850144896:12345-0@lo:400:kworker.0 Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683371.617037:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789683371.617048:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789683371.617053:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850144000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.617077:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850144000:12345-0@lo:400:kworker.0 Request processed in 24us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683371.617081:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789683371.617106:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850144128 00000100:00100000:1.0:1789683371.617110:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850144128 00000100:00100000:1.0:1789683371.617129:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850143872 00000100:00100000:1.0:1789683371.617132:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850143872 00000100:00100000:1.0:1789683371.617144:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789683371.617149:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850144128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.617189:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850144128:12345-0@lo:400:kworker.0 Request processed in 40us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683371.617195:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789683371.617208:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789683371.617213:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850143872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.617239:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850143872:12345-0@lo:400:kworker.0 Request processed in 27us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683371.617244:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789683371.617261:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850144640 00000100:00100000:1.0:1789683371.617264:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850144640 00000100:00100000:1.0:1789683371.617286:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850144512 00000100:00100000:1.0:1789683371.617289:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850144512 00000100:00100000:1.0:1789683371.617300:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850145024 00000100:00100000:1.0:1789683371.617303:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850145024 00000100:00100000:1.0:1789683371.617316:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789683371.617322:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850144640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.617352:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850144640:12345-0@lo:400:kworker.0 Request processed in 30us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683371.617358:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789683371.617370:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789683371.617376:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850144512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.617399:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850144512:12345-0@lo:400:kworker.0 Request processed in 24us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683371.617404:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789683371.617413:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789683371.617418:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850145024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.617469:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850145024:12345-0@lo:400:kworker.0 Request processed in 51us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683371.617475:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789683371.617506:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789683371.617509:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683371.617512:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789683371.617514:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683371.617544:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850144000:0@lo:400:kworker.0 00010000:00080000:1.0:1789683371.617558:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb790ed80 x1876618850144512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683371.617569:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850144512:0@lo:400:kworker.0 00010000:00080000:1.0:1789683371.617579:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb790ca80 x1876618850145024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683371.617587:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850145024:0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.617594:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850143872:0@lo:400:kworker.0 00010000:00080000:1.0:1789683371.617603:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb790f100 x1876618850144384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683371.617611:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850144384:0@lo:400:kworker.0 00010000:00080000:1.0:1789683371.617619:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb790fb80 x1876618850144896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683371.617626:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1876618850144896:0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.617660:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850144128:0@lo:400:kworker.0 00010000:00080000:1.0:1789683371.617669:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb790f800 x1876618850144640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683371.617683:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850144640:0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.617694:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850143744:0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.617702:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850144256:0@lo:400:kworker.0 00000100:00100000:1.0:1789683371.617709:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850144768:0@lo:400:kworker.0 00000100:00100000:2.0:1789683371.622522:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683371.624895:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850145152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683371.624979:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683371.625077:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850145152 00000100:00100000:3.0:1789683371.625086:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850145152 00000100:00100000:3.0:1789683371.625142:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789683371.625152:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850145152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683371.625179:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683371.625226:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850145152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683371.625232:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789683371.625373:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e8374aa00 x1876618850145152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683371.625392:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850145152:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789683372.066214:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683373.087230:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683373.589267:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683373.589315:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683373.589345:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683373.589373:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683373.589413:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835402368 00000100:00100000:2.0:1789683373.589422:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835402368 00000100:00100000:2.0:1789683373.589489:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:2.0:1789683373.589501:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835402368:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683373.589579:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835402368:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 81us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683373.589600:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:2.0:1789683373.589624:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835402112 00000100:00100000:2.0:1789683373.589628:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835402112 00000100:00100000:2.0:1789683373.589657:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835401984 00000100:00100000:2.0:1789683373.589660:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835401984 00000100:00100000:2.0:1789683373.589680:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 71 00000100:00100000:2.0:1789683373.589686:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835402112:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683373.589716:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835402112:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 30us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683373.589722:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 71 00000100:00100000:2.0:1789683373.589733:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:2.0:1789683373.589739:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835401984:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683373.589758:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835401984:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 20us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683373.589763:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00080000:2.0:1789683373.589778:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683373.589781:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789683373.589817:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683373.589979:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835401856 00000100:00100000:3.0:1789683373.589984:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835401856 00000100:00100000:3.0:1789683373.590021:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 279 00000100:00100000:3.0:1789683373.590028:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+10:2402:x1876618835401856:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683373.590059:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+10:2402:x1876618835401856:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 31us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683373.590065:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 279 00000100:00100000:3.0:1789683373.593412:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683373.593452:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835402240 00000100:00100000:3.0:1789683373.593463:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835402240 00000100:00100000:3.0:1789683373.593522:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 26 00000100:00100000:3.0:1789683373.593533:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8374b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835402240:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683373.593611:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8374b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835402240:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 80us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683373.593618:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 26 00000100:00080000:2.0:1789683373.594633:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683373.663316:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683373.663342:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850145280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683373.663466:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683373.663645:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850145280 00000100:00100000:2.0:1789683373.663655:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850145280 00000100:00100000:2.0:1789683373.663715:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789683373.663725:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850145280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789683373.663760:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789683373.663828:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850145280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683373.663849:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789683373.663908:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850145280:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789683374.119003:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683374.175134:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850145408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683374.175200:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683374.175342:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850145408 00000100:00100000:1.0:1789683374.175351:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850145408 00000100:00100000:1.0:1789683374.175417:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789683374.175427:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850145408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789683374.175461:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683374.175502:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850145408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683374.175508:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789683374.175561:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789683374.175594:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0724000 x1876618850145408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683374.175612:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850145408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683374.687729:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850145536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683374.687827:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683374.687975:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850145536 00000100:00100000:3.0:1789683374.687984:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850145536 00000100:00100000:3.0:1789683374.688044:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789683374.688053:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850145536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683374.688076:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683374.688210:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683374.688222:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850145664:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1789683374.688343:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683374.689543:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850145536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1486us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683374.689556:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789683374.697127:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683374.697261:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850145664 00000100:00100000:3.0:1789683374.697271:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850145664 00000100:00100000:3.0:1789683374.697330:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789683374.697340:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850145664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789683374.697377:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789683374.697440:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850145664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683374.697446:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789683374.697549:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850145664:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1789683374.698238:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83748000 x1876618850145536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683374.698254:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850145536:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789683375.139410:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683376.161266:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683376.237931:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683376.237953:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850145792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683376.238031:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683376.238094:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850145792 00000100:00100000:2.0:1789683376.238112:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850145792 00000100:00100000:2.0:1789683376.238165:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789683376.238175:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850145792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789683376.238204:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683376.238258:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850145792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683376.238266:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1789683376.238287:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789683376.239150:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d16d80 x1876618850145792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683376.239173:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850145792:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1789683376.414275:0:10699:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1789683376.739440:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850145920:0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.739524:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683376.739581:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850146432:0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.739610:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683376.739649:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850146944:0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.739684:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683376.739727:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789683376.739735:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850146048:0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.739763:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683376.740046:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1876618850146560:0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.740076:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683376.740097:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850147072:0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.740119:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683376.740155:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850146432 00000100:00100000:3.0:1789683376.740164:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850146432 00000100:00100000:3.0:1789683376.740215:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789683376.740223:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850146432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.740285:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850146432:12345-0@lo:400:kworker.0 Request processed in 62us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683376.740304:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789683376.740328:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850146944 00000100:00100000:3.0:1789683376.740332:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850146944 00000100:00100000:3.0:1789683376.740379:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789683376.740385:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850146944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.740420:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850146944:12345-0@lo:400:kworker.0 Request processed in 35us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683376.740425:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789683376.740442:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850146048 00000100:00100000:3.0:1789683376.740446:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850146048 00000100:00100000:3.0:1789683376.740469:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850146560 00000100:00100000:3.0:1789683376.740471:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850146560 00000100:00100000:3.0:1789683376.740483:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850147072 00000100:00100000:3.0:1789683376.740486:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850147072 00000100:00100000:3.0:1789683376.740498:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789683376.740512:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850146048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.740546:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850146048:12345-0@lo:400:kworker.0 Request processed in 34us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683376.740551:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789683376.740563:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789683376.740569:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8374aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876618850146560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.740595:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8374aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876618850146560:12345-0@lo:400:kworker.0 Request processed in 27us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683376.740600:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789683376.740610:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789683376.740616:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850147072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683376.740846:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850145920 00000100:00100000:1.0:1789683376.740852:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850145920 00000100:00100000:1.0:1789683376.740887:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789683376.740894:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850145920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683376.740933:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850145920:12345-0@lo:400:kworker.0 Request processed in 40us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683376.740946:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789683376.740995:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850147072:12345-0@lo:400:kworker.0 Request processed in 378us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683376.741002:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1789683376.741029:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683376.741033:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683376.741071:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850146048:0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.741083:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1876618850146560:0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.741093:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850147072:0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.741101:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850145920:0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.741110:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850146432:0@lo:400:kworker.0 00010000:00080000:3.0:1789683376.741121:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb790f800 x1876618850146944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683376.741144:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850146944:0@lo:400:kworker.0 00000100:00100000:0.0:1789683376.742042:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850146176:0@lo:400:kworker.0 00000100:00100000:0.0:1789683376.742091:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683376.742441:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683376.742454:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850147456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683376.742489:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683376.742514:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850146688:0@lo:400:kworker.0 00000100:00100000:0.0:1789683376.742543:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683376.742573:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850147200:0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.742587:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850146688 00000100:00100000:3.0:1789683376.742594:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850146688 00000100:00100000:0.0:1789683376.742599:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683376.742626:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789683376.742634:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850146304:0@lo:400:kworker.0 00000100:00100000:0.0:1789683376.742657:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683376.742678:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850146816:0@lo:400:kworker.0 00000100:00100000:0.0:1789683376.742722:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683376.742727:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850147200 00000100:00100000:3.0:1789683376.742732:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850147200 00000100:00100000:0.0:1789683376.742746:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850147328:0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.742753:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850146304 00000100:00100000:3.0:1789683376.742758:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850146304 00000100:00100000:0.0:1789683376.742773:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683376.742778:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789683376.742936:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850146688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.742990:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850146688:12345-0@lo:400:kworker.0 Request processed in 57us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683376.742997:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789683376.743012:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789683376.743018:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850147200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.743050:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850147200:12345-0@lo:400:kworker.0 Request processed in 33us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683376.743055:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789683376.743066:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789683376.743071:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850146304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.743095:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850146304:12345-0@lo:400:kworker.0 Request processed in 24us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683376.743100:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1789683376.743133:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683376.743150:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850146816 00000100:00100000:3.0:1789683376.743154:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850146816 00000100:00100000:3.0:1789683376.743195:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850147328 00000100:00100000:3.0:1789683376.743199:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850147328 00000100:00100000:3.0:1789683376.743218:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789683376.743224:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850146816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.743253:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850146816:12345-0@lo:400:kworker.0 Request processed in 30us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683376.743259:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789683376.743270:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789683376.743276:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850147328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683376.743760:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850147328:12345-0@lo:400:kworker.0 Request processed in 483us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683376.743767:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789683376.744014:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850146304:0@lo:400:kworker.0 00010000:00080000:3.0:1789683376.744028:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb790f480 x1876618850146816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683376.744038:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850146816:0@lo:400:kworker.0 00010000:00080000:3.0:1789683376.744046:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb790f100 x1876618850147328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683376.744055:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850147328:0@lo:400:kworker.0 00010000:00080000:3.0:1789683376.744065:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb790c000 x1876618850146688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683376.744073:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850146688:0@lo:400:kworker.0 00010000:00080000:3.0:1789683376.744095:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb790fb80 x1876618850147200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683376.744102:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850147200:0@lo:400:kworker.0 00000100:00080000:0.0:1789683376.745262:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683376.745273:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683376.745837:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850147456 00000100:00100000:2.0:1789683376.745848:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850147456 00000100:00100000:2.0:1789683376.745903:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789683376.745928:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850147456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683376.745955:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683376.746033:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850147456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (3543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683376.746040:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789683376.747314:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850146176 00000100:00100000:1.0:1789683376.747324:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850146176 00000100:00100000:1.0:1789683376.747383:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789683376.747392:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850146176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683376.747477:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850146176:12345-0@lo:400:kworker.0 Request processed in 87us (5385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683376.747483:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789683376.747583:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850146176:0@lo:400:kworker.0 00010000:00080000:2.0:1789683376.747879:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83748380 x1876618850147456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683376.747897:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850147456:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789683377.184019:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683378.227923:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683378.715161:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683378.715194:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683378.715217:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683378.715235:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683378.715256:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683378.715284:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835402496 00000100:00100000:3.0:1789683378.715294:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835402496 00000100:00100000:3.0:1789683378.715354:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 281 00000100:00100000:3.0:1789683378.715364:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+10:2404:x1876618835402496:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683378.715433:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+10:2404:x1876618835402496:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 69us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683378.715440:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 281 00000100:00100000:3.0:1789683378.715491:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835402752 00000100:00100000:3.0:1789683378.715495:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835402752 00000100:00100000:3.0:1789683378.715535:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835402624 00000100:00100000:3.0:1789683378.715537:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835402624 00000100:00100000:3.0:1789683378.715557:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 79 00000100:00100000:3.0:1789683378.715563:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835402752:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683378.715593:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835402752:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 30us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683378.715599:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 79 00000100:00100000:3.0:1789683378.715612:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 80 00000100:00100000:3.0:1789683378.715618:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+6:2404:x1876618835402624:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683378.715653:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+6:2404:x1876618835402624:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 35us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683378.715660:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 80 00000100:00100000:3.0:1789683378.715678:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835403008 00000100:00100000:3.0:1789683378.715682:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835403008 00000100:00100000:3.0:1789683378.715705:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835402880 00000100:00100000:3.0:1789683378.715708:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835402880 00000100:00100000:3.0:1789683378.715726:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:3.0:1789683378.715732:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835403008:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683378.715757:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835403008:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683378.715763:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:3.0:1789683378.715774:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:3.0:1789683378.715780:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835402880:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683378.715834:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835402880:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 54us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683378.715841:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00080000:3.0:1789683378.715971:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789683378.715975:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789683378.715978:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683378.715979:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683378.783080:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850147584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683378.783152:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683378.783344:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850147584 00000100:00100000:2.0:1789683378.783352:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850147584 00000100:00100000:2.0:1789683378.783408:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789683378.783419:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850147584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789683378.783466:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789683378.783513:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850147584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683378.783521:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789683378.784185:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850147584:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789683379.235956:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683379.299930:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850147712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683379.300022:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683379.300097:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850147712 00000100:00100000:3.0:1789683379.300112:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850147712 00000100:00100000:3.0:1789683379.300178:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789683379.300189:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850147712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789683379.300232:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683379.310319:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850147712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10111us (10276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683379.310336:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789683379.310378:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789683379.315253:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb790d880 x1876618850147712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683379.315283:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850147712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683379.806952:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850147968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683379.806952:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683379.806971:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850147840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683379.807082:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683379.807397:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850147968 00000100:00100000:1.0:1789683379.807405:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850147968 00000100:00100000:0.0:1789683379.807835:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683379.808647:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850147840 00000100:00100000:2.0:1789683379.808656:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850147840 00000100:00100000:2.0:1789683379.808716:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789683379.808727:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850147840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683379.808763:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789683379.808862:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850147840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683379.808868:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789683379.808929:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850147840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683379.812724:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789683379.812738:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850147968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683379.812767:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683379.812872:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850147968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (5791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683379.812879:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1789683379.813630:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789683379.813689:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc14ac380 x1876618850147968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683379.813712:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850147968:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789683380.257028:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683381.285158:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683381.343817:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683381.343840:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850148096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683381.343966:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683381.344156:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850148096 00000100:00100000:0.0:1789683381.344166:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850148096 00000100:00100000:0.0:1789683381.344232:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789683381.344242:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850148096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789683381.344279:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683381.344328:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850148096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683381.344335:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1789683381.344378:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d17480 x1876618850148096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683381.344397:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850148096:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789683381.344463:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1789683381.628330:0:10943:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing yml_node 00000100:00100000:3.0:1789683381.855009:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850148224:0@lo:400:kworker.0 00000100:00100000:3.0:1789683381.855083:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683381.856421:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850148480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683381.856474:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683381.856521:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850148480 00000100:00100000:2.0:1789683381.856529:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850148480 00000100:00100000:2.0:1789683381.856586:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789683381.856594:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850148480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683381.856617:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683381.856660:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850148480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683381.856667:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1789683381.856687:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789683381.856714:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d17b80 x1876618850148480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683381.856733:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850148480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683381.857549:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850148224 00000100:00100000:2.0:1789683381.857562:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850148224 00000100:00100000:2.0:1789683381.857610:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789683381.857627:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3649:x1876618850148224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683381.857686:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3649:x1876618850148224:12345-0@lo:400:kworker.0 Request processed in 61us (2603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683381.857693:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789683381.857914:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850148224:0@lo:400:kworker.0 00000100:00100000:3.0:1789683381.857931:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683381.857940:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850148352:0@lo:400:kworker.0 00000100:00100000:3.0:1789683381.857975:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683381.859655:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850148608:0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.859714:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683381.859771:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850148608 00000100:00100000:1.0:1789683381.859778:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850148608 00000100:00100000:1.0:1789683381.859846:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789683381.859855:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850148608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.859913:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850148608:12345-0@lo:400:kworker.0 Request processed in 58us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683381.859928:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789683381.859971:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850148608:0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.860026:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683381.860034:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850148736:0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.860061:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683381.865404:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850148352 00000100:00100000:2.0:1789683381.865422:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850148352 00000100:00100000:2.0:1789683381.865500:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850148736 00000100:00100000:2.0:1789683381.865504:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850148736 00000100:00100000:2.0:1789683381.865540:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789683381.865550:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850148352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683381.865642:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850148352:12345-0@lo:400:kworker.0 Request processed in 93us (7666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683381.865649:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789683381.865666:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789683381.865672:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850148736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683381.865709:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850148736:12345-0@lo:400:kworker.0 Request processed in 37us (5647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683381.865727:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789683381.868604:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850148736:0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.868676:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850148352:0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.868858:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1876618850148992:0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.868928:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683381.868973:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850148992 00000100:00100000:1.0:1789683381.868981:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850148992 00000100:00100000:1.0:1789683381.869031:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789683381.869041:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876618850148992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.869091:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876618850148992:12345-0@lo:400:kworker.0 Request processed in 52us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683381.869098:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1789683381.869121:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683381.869145:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1876618850148992:0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.869157:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683381.869163:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850148864:0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.869188:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683381.869215:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850148864 00000100:00100000:1.0:1789683381.869219:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850148864 00000100:00100000:1.0:1789683381.869242:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789683381.869272:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850148864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.869308:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850148864:12345-0@lo:400:kworker.0 Request processed in 53us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683381.869314:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789683381.869341:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850148864:0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.869373:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850149120:0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.869397:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683381.869424:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850149120 00000100:00100000:1.0:1789683381.869429:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850149120 00000100:00100000:1.0:1789683381.869453:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789683381.869460:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850149120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.869493:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850149120:12345-0@lo:400:kworker.0 Request processed in 35us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683381.869499:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1789683381.869513:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789683381.869532:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb790ed80 x1876618850149120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683381.869542:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850149120:0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.869585:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850149504:0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.869609:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683381.869634:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850149504 00000100:00100000:1.0:1789683381.869638:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850149504 00000100:00100000:1.0:1789683381.869665:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789683381.869671:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850149504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.869702:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850149504:12345-0@lo:400:kworker.0 Request processed in 32us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683381.869917:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850149376:0@lo:400:kworker.0 00000100:00100000:0.0:1789683381.869953:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683381.869979:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683381.869985:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850149248:0@lo:400:kworker.0 00000100:00100000:0.0:1789683381.870007:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683381.870073:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850149376 00000100:00100000:0.0:1789683381.870077:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850149376 00000100:00100000:0.0:1789683381.870107:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850149248 00000100:00100000:0.0:1789683381.870110:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850149248 00000100:00100000:0.0:1789683381.870143:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789683381.870150:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850149376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683381.870190:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850149376:12345-0@lo:400:kworker.0 Request processed in 42us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683381.870196:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789683381.870208:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789683381.870214:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850149248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683381.870239:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850149248:12345-0@lo:400:kworker.0 Request processed in 25us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683381.870244:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789683381.870291:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb790ed80 x1876618850149248/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683381.870301:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850149248:0@lo:400:kworker.0 00010000:00080000:0.0:1789683381.870310:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb790f100 x1876618850149376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683381.870317:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850149376:0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.877354:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1789683381.877416:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683381.877423:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683381.877485:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850149504:0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.877566:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850149632:0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.877628:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683381.877669:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850149632 00000100:00100000:1.0:1789683381.877676:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850149632 00000100:00100000:1.0:1789683381.877831:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789683381.877841:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876618850149632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683381.877892:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876618850149632:12345-0@lo:400:kworker.0 Request processed in 53us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683381.877898:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1789683381.877914:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789683381.877934:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb790f480 x1876618850149632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683381.877944:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850149632:0@lo:400:kworker.0 00010000:00010000:1.0:1789683382.303365:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683383.327251:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683383.835295:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683383.835404:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683383.835444:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683383.835498:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835403392 00000100:00100000:3.0:1789683383.835510:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835403392 00000100:00100000:3.0:1789683383.835566:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835403264 00000100:00100000:3.0:1789683383.835570:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835403264 00000100:00100000:3.0:1789683383.835595:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 87 00000100:00100000:3.0:1789683383.835606:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835403392:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683383.835688:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835403392:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 83us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683383.835711:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 87 00000100:00100000:3.0:1789683383.835729:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 88 00000100:00100000:3.0:1789683383.835736:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+6:2403:x1876618835403264:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683383.835762:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+6:2403:x1876618835403264:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 27us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683383.835767:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 88 00000100:00080000:3.0:1789683383.835942:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683383.835946:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683383.842108:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835403136 00000100:00100000:1.0:1789683383.842125:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835403136 00000100:00100000:1.0:1789683383.842199:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 283 00000100:00100000:1.0:1789683383.842209:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+10:2403:x1876618835403136:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683383.842304:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+10:2403:x1876618835403136:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 96us (7019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683383.842326:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 283 00000100:00100000:3.0:1789683383.843878:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683383.843927:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683383.844199:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835403520 00000100:00100000:0.0:1789683383.844208:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835403520 00000100:00100000:0.0:1789683383.844291:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835403648 00000100:00100000:0.0:1789683383.844295:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835403648 00000100:00100000:0.0:1789683383.844322:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:0.0:1789683383.844331:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2401:x1876618835403520:12345-192.168.201.50@tcp:9:kworker.0 00000020:00000080:0.0:1789683383.844369:0:8439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88961a 00000100:00080000:0.0:1789683383.844379:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9f0e83447000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789683383.844422:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789683383.844593:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+2:2401:x1876618835403520:12345-192.168.201.50@tcp:9:kworker.0 Request processed in 262us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683383.844600:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:0.0:1789683383.844760:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:0.0:1789683383.844767:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2401:x1876618835403648:12345-192.168.201.50@tcp:9:kworker.0 00000020:00000080:0.0:1789683383.844833:0:8439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889621 00000100:00080000:0.0:1789683383.844840:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9f0e83446800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789683383.844863:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789683383.844935:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+2:2401:x1876618835403648:12345-192.168.201.50@tcp:9:kworker.0 Request processed in 168us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683383.844942:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00010000:00010000:0.0:1789683383.844964:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683383.845204:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789683383.845741:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789683383.845746:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683383.903304:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850149760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683383.903376:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683383.903541:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850149760 00000100:00100000:2.0:1789683383.903551:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850149760 00000100:00100000:2.0:1789683383.903608:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789683383.903618:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850149760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789683383.903935:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789683383.903991:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850149760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 375us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683383.903998:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789683383.916908:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850149760:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789683384.351012:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683384.420501:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850149888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683384.420578:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683384.420642:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850149888 00000100:00100000:3.0:1789683384.420652:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850149888 00000100:00100000:3.0:1789683384.420721:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789683384.420732:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850149888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789683384.420761:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683384.420840:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850149888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683384.420848:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1789683384.421110:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb790dc00 x1876618850149888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683384.421128:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850149888:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789683384.422281:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683384.928009:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850150016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683384.928084:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683384.928259:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850150144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683384.928265:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850150016 00000100:00100000:3.0:1789683384.928275:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850150016 00000100:00100000:2.0:1789683384.928301:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683384.928343:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789683384.928348:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850150144 00000100:00100000:3.0:1789683384.928354:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850150016:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683384.928354:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850150144 00000100:00100000:2.0:1789683384.928387:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00002000:00000024:3.0:1789683384.928390:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683384.928397:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850150144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683384.928430:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789683384.928469:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850150144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683384.928476:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789683384.928520:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850150144:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1789683384.928556:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683384.933400:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850150016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5036us (5305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683384.933438:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1789683384.944547:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7246300 x1876618850150016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683384.944577:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850150016:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789683385.377246:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789683386.016710:0:11127:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:0.0:1789683386.405802:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683386.465362:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850150272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683386.465446:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683386.465624:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850150272 00000100:00100000:2.0:1789683386.465632:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850150272 00000100:00100000:2.0:1789683386.465699:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789683386.465710:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850150272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789683386.465742:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683386.465828:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850150272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683386.465835:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1789683386.466915:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789683386.467210:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d15f80 x1876618850150272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683386.467234:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850150272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789683386.975078:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850150400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683386.975147:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683386.976662:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850150400 00000100:00100000:2.0:1789683386.976675:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850150400 00000100:00100000:2.0:1789683386.976751:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789683386.976761:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850150400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683386.976806:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683386.976873:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850150400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683386.976897:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1789683386.977011:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789683386.977051:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d15c00 x1876618850150400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683386.977072:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850150400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683386.985475:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850150656:0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.986758:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683386.986835:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850151168:0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.986878:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683386.986903:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850151680:0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.986926:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683386.986957:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789683386.986965:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850150528:0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.986997:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683386.987025:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850151040:0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.987049:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683386.987067:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850151552:0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.987089:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683386.987131:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850150784:0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.987155:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683386.987191:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850151296:0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.987213:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683386.987234:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850151808:0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.987285:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683386.987306:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789683386.987312:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850150912:0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.987336:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683386.987357:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850151424:0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.990442:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683386.990503:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850151936:0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.991481:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683386.992524:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850150656 00000100:00100000:3.0:1789683386.992603:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850150656 00000100:00100000:3.0:1789683386.992653:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850151168 00000100:00100000:3.0:1789683386.992657:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850151168 00000100:00100000:3.0:1789683386.992687:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850151680 00000100:00100000:3.0:1789683386.992690:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850151680 00000100:00100000:3.0:1789683386.992702:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850151296 00000100:00100000:3.0:1789683386.992704:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850151296 00000100:00100000:3.0:1789683386.992715:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850151808 00000100:00100000:3.0:1789683386.992717:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850151808 00000100:00100000:3.0:1789683386.992727:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850150912 00000100:00100000:3.0:1789683386.992729:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850150912 00000100:00100000:3.0:1789683386.992748:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789683386.992758:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850150656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.992862:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850150656:12345-0@lo:400:kworker.0 Request processed in 105us (6109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683386.992868:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789683386.992885:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789683386.992890:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850151168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.992921:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850151168:12345-0@lo:400:kworker.0 Request processed in 31us (6042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683386.992926:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789683386.992936:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789683386.992941:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850151680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.992982:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850151680:12345-0@lo:400:kworker.0 Request processed in 40us (6055us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683386.992988:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789683386.993001:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789683386.993007:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850151296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.993039:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850151296:12345-0@lo:400:kworker.0 Request processed in 33us (5826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683386.993044:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789683386.993056:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789683386.993061:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850151808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.993088:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850151808:12345-0@lo:400:kworker.0 Request processed in 28us (5803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683386.993093:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789683386.993104:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789683386.993110:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850150912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.993138:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850150912:12345-0@lo:400:kworker.0 Request processed in 28us (5802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683386.993143:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789683386.993184:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850150528 00000100:00100000:3.0:1789683386.993188:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850150528 00000100:00100000:3.0:1789683386.993222:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789683386.993228:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f93123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850150528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.993258:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f93123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850150528:12345-0@lo:400:kworker.0 Request processed in 31us (6260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683386.993264:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789683386.993305:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850151040 00000100:00100000:3.0:1789683386.993309:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850151040 00000100:00100000:3.0:1789683386.993333:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850150784 00000100:00100000:3.0:1789683386.993337:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850150784 00000100:00100000:3.0:1789683386.993350:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789683386.993355:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850151040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.994121:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850151040:12345-0@lo:400:kworker.0 Request processed in 762us (7067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683386.994130:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789683386.994149:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789683386.994158:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850150784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.994201:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850150784:12345-0@lo:400:kworker.0 Request processed in 46us (7045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683386.994206:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789683386.994230:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850151552 00000100:00100000:3.0:1789683386.994236:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850151552 00000100:00100000:3.0:1789683386.994274:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850151424 00000100:00100000:3.0:1789683386.994278:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850151424 00000100:00100000:3.0:1789683386.994289:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850151936 00000100:00100000:3.0:1789683386.994292:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850151936 00000100:00100000:3.0:1789683386.994308:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789683386.994314:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850151552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.994346:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850151552:12345-0@lo:400:kworker.0 Request processed in 32us (7255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683386.994351:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789683386.994362:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789683386.994367:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850151424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.994393:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850151424:12345-0@lo:400:kworker.0 Request processed in 26us (3961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683386.994407:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789683386.994418:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789683386.994424:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850151936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.994453:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850151936:12345-0@lo:400:kworker.0 Request processed in 30us (2974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683386.994458:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789683386.994519:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850150528:0@lo:400:kworker.0 00000100:00080000:0.0:1789683386.995676:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683386.995685:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683386.995688:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683386.995996:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850150912:0@lo:400:kworker.0 00010000:00080000:0.0:1789683386.996015:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7998700 x1876618850151424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683386.996026:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850151424:0@lo:400:kworker.0 00010000:00080000:0.0:1789683386.996038:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7999c00 x1876618850151936/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683386.996046:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850151936:0@lo:400:kworker.0 00000100:00100000:0.0:1789683386.996058:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850150784:0@lo:400:kworker.0 00010000:00080000:0.0:1789683386.996072:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb799b800 x1876618850151296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683386.996081:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850151296:0@lo:400:kworker.0 00010000:00080000:0.0:1789683386.996095:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7998000 x1876618850151808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683386.996103:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850151808:0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.997804:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850151040:0@lo:400:kworker.0 00010000:00080000:3.0:1789683386.997869:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb799ad80 x1876618850151552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683386.997884:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850151552:0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.997904:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850150656:0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.997918:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850151168:0@lo:400:kworker.0 00000100:00100000:3.0:1789683386.997931:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850151680:0@lo:400:kworker.0 00010000:00010000:2.0:1789683387.423117:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683388.453706:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789683388.792858:0:11224:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000100:00100000:0.0:1789683388.973210:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683388.973246:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683388.973281:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683388.973324:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835404032 00000100:00100000:0.0:1789683388.973336:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835404032 00000100:00100000:0.0:1789683388.973392:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835403904 00000100:00100000:0.0:1789683388.973396:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835403904 00000100:00100000:0.0:1789683388.973421:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 95 00000100:00100000:0.0:1789683388.973431:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835404032:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683388.973502:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835404032:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 72us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683388.973509:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 95 00000100:00100000:0.0:1789683388.973524:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 96 00000100:00100000:0.0:1789683388.973529:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+6:2405:x1876618835403904:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683388.973551:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+6:2405:x1876618835403904:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 22us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683388.973557:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 96 00000100:00080000:0.0:1789683388.973576:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683388.973579:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789683388.973972:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835403776 00000100:00100000:2.0:1789683388.973979:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835403776 00000100:00100000:2.0:1789683388.974030:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 285 00000100:00100000:2.0:1789683388.974038:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+10:2405:x1876618835403776:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683388.974068:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+10:2405:x1876618835403776:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 32us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683388.974074:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 285 00000100:00100000:1.0:1789683389.028955:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683389.028979:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850152064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683389.029064:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683389.029144:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850152064 00000100:00100000:1.0:1789683389.029152:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850152064 00000100:00100000:1.0:1789683389.029202:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789683389.029211:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850152064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683389.029249:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789683389.029298:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850152064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683389.029305:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789683389.029353:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850152064:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789683389.474938:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683389.538530:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850152192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683389.538618:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683389.538823:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850152192 00000100:00100000:3.0:1789683389.538833:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850152192 00000100:00100000:3.0:1789683389.538911:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789683389.538922:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850152192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789683389.538956:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789683389.539029:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683389.539576:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850152192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 655us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683389.539585:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789683389.541351:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83cac000 x1876618850152192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683389.541379:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850152192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683390.047002:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683390.047025:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850152320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683390.047099:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683390.047160:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850152320 00000100:00100000:2.0:1789683390.047168:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850152320 00000100:00100000:2.0:1789683390.047225:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789683390.047234:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850152320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683390.047283:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789683390.047340:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850152320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683390.047347:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789683390.047401:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850152320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683390.048002:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683390.050758:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850152448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683390.051863:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1789683390.052666:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec036ece-1720-411a-849c-c978dbb41f8a 00000020:00000080:0.0:1789683390.052673:0:8433:0:(genops.c:885:class_export_put()) final put ffff9f0e83444800/ec036ece-1720-411a-849c-c978dbb41f8a 00000100:00100000:2.0:1789683390.053733:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850152448 00000100:00100000:2.0:1789683390.053744:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850152448 00000100:00100000:3.0:1789683390.054066:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789683390.054076:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850152448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683390.054105:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683390.054181:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850152448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (2320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683390.054201:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789683390.054248:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc070ad80 x1876618850152448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683390.054269:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850152448:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789683390.054873:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1789683390.055274:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec036ece-1720-411a-849c-c978dbb41f8a 00000020:00000080:3.0:1789683390.055279:0:9518:0:(genops.c:885:class_export_put()) final put ffff9f0e83447800/ec036ece-1720-411a-849c-c978dbb41f8a 00000020:00000080:1.0:1789683390.055348:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83444800/ec036ece-1720-411a-849c-c978dbb41f8a for lustre-OST0000 00000020:00000080:1.0:1789683390.055447:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e83447000 for lustre-OST0000 00000020:00000080:0.0:1789683390.066942:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83447800/ec036ece-1720-411a-849c-c978dbb41f8a for lustre-OST0001 00000020:00000080:0.0:1789683390.067014:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e83446800 for lustre-OST0001 00010000:00010000:0.0:1789683390.499650:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683391.519125:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683391.588963:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850152576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789683391.589040:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683391.589124:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850152576 00000100:00100000:0.0:1789683391.589132:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850152576 00000100:00100000:0.0:1789683391.589181:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789683391.589214:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850152576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789683391.589247:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683391.589292:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850152576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683391.589299:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1789683391.589321:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789683391.589351:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc070bb80 x1876618850152576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683391.589371:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850152576:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1789683391.725611:0:11322:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:0.0:1789683392.095266:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850152832:0@lo:400:kworker.0 00000100:00100000:0.0:1789683392.095335:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683392.095393:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850153344:0@lo:400:kworker.0 00000100:00100000:0.0:1789683392.095415:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683392.095437:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850153856:0@lo:400:kworker.0 00000100:00100000:0.0:1789683392.095475:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683392.095499:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789683392.095505:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850152960:0@lo:400:kworker.0 00000100:00100000:0.0:1789683392.095529:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683392.095549:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850153472:0@lo:400:kworker.0 00000100:00100000:0.0:1789683392.095566:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683392.095581:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850153984:0@lo:400:kworker.0 00000100:00100000:0.0:1789683392.095599:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683392.095622:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850152832 00000100:00100000:0.0:1789683392.095629:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850152832 00000100:00100000:0.0:1789683392.095664:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850153344 00000100:00100000:0.0:1789683392.095679:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850153344 00000100:00100000:0.0:1789683392.095702:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850153856 00000100:00100000:0.0:1789683392.095704:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850153856 00000100:00100000:0.0:1789683392.095715:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850153472 00000100:00100000:0.0:1789683392.095718:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850153472 00000100:00100000:0.0:1789683392.095730:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850153984 00000100:00100000:0.0:1789683392.095732:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850153984 00000100:00100000:0.0:1789683392.095747:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789683392.095755:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850152832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683392.095831:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850152832:12345-0@lo:400:kworker.0 Request processed in 76us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683392.095838:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789683392.095854:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789683392.095860:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850153344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683392.095888:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850153344:12345-0@lo:400:kworker.0 Request processed in 29us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683392.095894:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789683392.095905:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789683392.095911:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850153856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683392.095938:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850153856:12345-0@lo:400:kworker.0 Request processed in 27us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683392.095943:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789683392.095954:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789683392.095960:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850153472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683392.095986:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850153472:12345-0@lo:400:kworker.0 Request processed in 27us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683392.095992:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789683392.096011:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789683392.096016:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850153984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683392.096046:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850153984:12345-0@lo:400:kworker.0 Request processed in 30us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683392.096051:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789683392.096093:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850152960 00000100:00100000:0.0:1789683392.096097:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850152960 00000100:00100000:0.0:1789683392.096122:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789683392.096129:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850152960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683392.096162:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850152960:12345-0@lo:400:kworker.0 Request processed in 33us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683392.096168:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1789683392.096186:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683392.096190:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683392.096219:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850152960:0@lo:400:kworker.0 00010000:00080000:0.0:1789683392.096232:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb799ad80 x1876618850153472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683392.096242:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850153472:0@lo:400:kworker.0 00010000:00080000:0.0:1789683392.096250:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7998700 x1876618850153984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683392.096258:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850153984:0@lo:400:kworker.0 00000100:00100000:0.0:1789683392.096266:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850152832:0@lo:400:kworker.0 00000100:00100000:0.0:1789683392.096274:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850153344:0@lo:400:kworker.0 00000100:00100000:0.0:1789683392.096282:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850153856:0@lo:400:kworker.0 00000100:00100000:3.0:1789683392.096397:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850153088:0@lo:400:kworker.0 00000100:00100000:3.0:1789683392.096428:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683392.096463:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850153600:0@lo:400:kworker.0 00000100:00100000:3.0:1789683392.096486:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683392.096506:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850154112:0@lo:400:kworker.0 00000100:00100000:3.0:1789683392.096526:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683392.096544:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1789683392.096550:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850152704:0@lo:400:kworker.0 00000100:00100000:3.0:1789683392.096584:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683392.096605:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850153216:0@lo:400:kworker.0 00000100:00100000:3.0:1789683392.096623:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683392.096636:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850153728:0@lo:400:kworker.0 00000100:00100000:3.0:1789683392.096652:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683392.096666:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850154240:0@lo:400:kworker.0 00000100:00100000:3.0:1789683392.096682:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683392.096704:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850153600 00000100:00100000:3.0:1789683392.096708:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850153600 00000100:00100000:3.0:1789683392.096730:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850154112 00000100:00100000:3.0:1789683392.096733:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850154112 00000100:00100000:3.0:1789683392.096742:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850153728 00000100:00100000:3.0:1789683392.096744:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850153728 00000100:00100000:3.0:1789683392.096753:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850154240 00000100:00100000:3.0:1789683392.096755:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850154240 00000100:00100000:3.0:1789683392.096768:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789683392.096774:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850153600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683392.096833:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850153600:12345-0@lo:400:kworker.0 Request processed in 59us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683392.096838:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789683392.096850:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789683392.096855:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850154112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683392.096878:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850154112:12345-0@lo:400:kworker.0 Request processed in 23us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683392.096883:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789683392.096891:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789683392.096896:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850153728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683392.096926:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850153728:12345-0@lo:400:kworker.0 Request processed in 31us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683392.096931:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789683392.096941:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789683392.096946:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850154240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683392.096965:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850154240:12345-0@lo:400:kworker.0 Request processed in 19us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683392.096969:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789683392.096987:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850152704 00000100:00100000:3.0:1789683392.096990:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850152704 00000100:00100000:3.0:1789683392.097010:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789683392.097015:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850152704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683392.097040:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850152704:12345-0@lo:400:kworker.0 Request processed in 25us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683392.097045:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789683392.097068:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850153216 00000100:00100000:3.0:1789683392.097086:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850153216 00000100:00100000:3.0:1789683392.097107:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789683392.097115:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850153216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683392.097142:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850153216:12345-0@lo:400:kworker.0 Request processed in 29us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683392.097147:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789683392.097175:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850152704:0@lo:400:kworker.0 00000100:00100000:3.0:1789683392.097184:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850153216:0@lo:400:kworker.0 00010000:00080000:3.0:1789683392.097193:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb799b800 x1876618850153728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683392.097208:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850153728:0@lo:400:kworker.0 00010000:00080000:3.0:1789683392.097220:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f88cdd180 x1876618850154240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683392.097228:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850154240:0@lo:400:kworker.0 00010000:00080000:3.0:1789683392.097237:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7998000 x1876618850153600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683392.097243:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850153600:0@lo:400:kworker.0 00010000:00080000:3.0:1789683392.097251:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f88cdd880 x1876618850154112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683392.097258:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850154112:0@lo:400:kworker.0 00000100:00080000:0.0:1789683392.097470:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683392.097474:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683392.097485:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850153088 00000100:00100000:0.0:1789683392.097490:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850153088 00000100:00100000:0.0:1789683392.097523:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789683392.097530:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850153088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683392.097569:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850153088:12345-0@lo:400:kworker.0 Request processed in 39us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683392.097575:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789683392.097601:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850153088:0@lo:400:kworker.0 00000100:00100000:2.0:1789683392.098038:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683392.098049:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850154368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683392.098101:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683392.098141:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850154368 00000100:00100000:2.0:1789683392.098147:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850154368 00000100:00100000:2.0:1789683392.098176:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789683392.098182:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850154368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683392.098214:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683392.098250:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850154368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683392.098256:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789683392.098286:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d17800 x1876618850154368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683392.098299:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850154368:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789683392.543025:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683393.570729:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789683393.592301:0:11370:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 17 18:16:32 EDT 2026 00000100:00100000:2.0:1789683394.070338:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683394.070379:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683394.070415:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683394.070503:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835404416 00000100:00100000:1.0:1789683394.070519:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835404416 00000100:00100000:3.0:1789683394.070605:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835404160 00000100:00100000:3.0:1789683394.070612:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835404160 00000100:00100000:1.0:1789683394.070612:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835404288 00000100:00100000:1.0:1789683394.070618:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835404288 00000100:00100000:1.0:1789683394.070656:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 103 00000100:00100000:3.0:1789683394.070657:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 287 00000100:00100000:1.0:1789683394.070667:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835404416:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683394.070673:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc2073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+10:2404:x1876618835404160:12345-192.168.201.50@tcp:400:kworker.0 00000100:00080000:2.0:1789683394.070750:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683394.070755:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789683394.070815:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 104 00000100:00100000:2.0:1789683394.070826:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2404:x1876618835404288:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683394.070905:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835404416:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 238us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683394.070914:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 103 00000100:00100000:3.0:1789683394.075772:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc2073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+10:2404:x1876618835404160:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 5091us (5438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683394.075805:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 287 00000100:00100000:2.0:1789683394.080194:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2404:x1876618835404288:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 9357us (9764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683394.080213:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 104 00000100:00100000:0.0:1789683394.143117:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683394.143146:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850154496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683394.143261:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683394.143433:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850154496 00000100:00100000:3.0:1789683394.143443:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850154496 00000100:00100000:3.0:1789683394.143514:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789683394.143525:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850154496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789683394.143564:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789683394.143643:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850154496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683394.143651:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789683394.143899:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850154496:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789683394.591454:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683394.655090:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683394.655115:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850154624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683394.655255:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683394.655358:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850154624 00000100:00100000:2.0:1789683394.655370:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850154624 00000100:00100000:2.0:1789683394.655438:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789683394.655449:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850154624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789683394.655480:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683394.655543:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850154624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683394.655550:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1789683394.655594:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d15c00 x1876618850154624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683394.655612:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850154624:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789683394.655737:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683395.166994:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850154752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683395.167076:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683395.167177:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850154752 00000100:00100000:1.0:1789683395.167187:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850154752 00000100:00100000:1.0:1789683395.167240:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789683395.167249:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850154752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683395.167287:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789683395.167347:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850154752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683395.167354:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789683395.167399:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850154752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683395.169744:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683395.169763:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850154880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683395.169845:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683395.172833:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850154880 00000100:00100000:0.0:1789683395.172847:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850154880 00000100:00100000:0.0:1789683395.172937:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789683395.172949:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850154880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683395.172974:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683395.173072:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850154880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (3227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683395.173079:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789683395.173234:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789683395.173369:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb799b800 x1876618850154880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683395.173419:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850154880:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789683395.614945:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683396.639905:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683396.704181:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683396.704205:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850155008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683396.704273:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683396.715688:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850155008 00000100:00100000:2.0:1789683396.715702:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850155008 00000100:00100000:3.0:1789683396.716508:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789683396.716520:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850155008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789683396.716555:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683396.716647:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850155008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (12374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683396.716655:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1789683396.716758:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d15f80 x1876618850155008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683396.716779:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850155008:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789683396.725739:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683397.215134:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850155520:0@lo:400:kworker.0 00000100:00100000:1.0:1789683397.215207:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683397.215261:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850156032:0@lo:400:kworker.0 00000100:00100000:1.0:1789683397.215310:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683397.215330:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850156544:0@lo:400:kworker.0 00000100:00100000:1.0:1789683397.215352:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683397.215374:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789683397.215380:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850155392:0@lo:400:kworker.0 00000100:00100000:1.0:1789683397.215402:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683397.215417:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850155904:0@lo:400:kworker.0 00000100:00100000:1.0:1789683397.215435:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683397.215474:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850156416:0@lo:400:kworker.0 00000100:00100000:1.0:1789683397.215496:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683397.215527:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850155520 00000100:00100000:1.0:1789683397.215534:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850155520 00000100:00100000:1.0:1789683397.215577:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850155904 00000100:00100000:1.0:1789683397.215581:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850155904 00000100:00100000:1.0:1789683397.215602:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850156416 00000100:00100000:1.0:1789683397.215605:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850156416 00000100:00100000:1.0:1789683397.215621:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789683397.215629:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850155520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683397.215683:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850155520:12345-0@lo:400:kworker.0 Request processed in 55us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683397.215689:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789683397.215707:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789683397.215713:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850155904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683397.215739:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850155904:12345-0@lo:400:kworker.0 Request processed in 27us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683397.215745:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789683397.215755:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789683397.215761:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850156416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683397.215815:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850156416:12345-0@lo:400:kworker.0 Request processed in 54us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683397.215822:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1789683397.215843:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789683397.215869:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83caea00 x1876618850155904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683397.215895:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850155904:0@lo:400:kworker.0 00010000:00080000:1.0:1789683397.215914:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83cace00 x1876618850156416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683397.215922:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850156416:0@lo:400:kworker.0 00000100:00100000:1.0:1789683397.215930:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850155520:0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.216107:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850155264:0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.216138:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683397.216165:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850155776:0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.216184:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683397.216203:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850156288:0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.216223:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683397.216238:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789683397.216242:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850155136:0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.216265:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683397.216290:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850155648:0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.216310:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683397.216326:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850156160:0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.216343:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683397.216356:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850156672:0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.216372:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683397.216395:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850156032 00000100:00100000:3.0:1789683397.216406:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850156032 00000100:00100000:3.0:1789683397.216438:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850156544 00000100:00100000:3.0:1789683397.216441:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850156544 00000100:00100000:3.0:1789683397.216454:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850156160 00000100:00100000:3.0:1789683397.216456:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850156160 00000100:00100000:3.0:1789683397.216467:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850156672 00000100:00100000:3.0:1789683397.216470:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850156672 00000100:00100000:3.0:1789683397.216484:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789683397.216490:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850156032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.216530:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850156032:12345-0@lo:400:kworker.0 Request processed in 40us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683397.216535:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789683397.216548:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789683397.216554:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850156544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.216583:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850156544:12345-0@lo:400:kworker.0 Request processed in 30us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683397.216588:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789683397.216599:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789683397.216604:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850156160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.216634:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850156160:12345-0@lo:400:kworker.0 Request processed in 30us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683397.216639:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789683397.216649:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789683397.216655:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850156672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.216679:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850156672:12345-0@lo:400:kworker.0 Request processed in 24us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683397.216684:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789683397.216716:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850155136 00000100:00100000:3.0:1789683397.216719:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850155136 00000100:00100000:3.0:1789683397.216744:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789683397.216749:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc2071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850155136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.216780:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc2071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850155136:12345-0@lo:400:kworker.0 Request processed in 30us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683397.216816:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789683397.216844:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850155392 00000100:00100000:3.0:1789683397.216848:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850155392 00000100:00100000:3.0:1789683397.216872:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850155648 00000100:00100000:3.0:1789683397.216875:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850155648 00000100:00100000:3.0:1789683397.216887:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789683397.216892:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850155392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.216925:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850155392:12345-0@lo:400:kworker.0 Request processed in 33us (1522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683397.216930:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789683397.216942:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789683397.216948:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850155648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.216975:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850155648:12345-0@lo:400:kworker.0 Request processed in 28us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683397.216995:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789683397.217027:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850155264 00000100:00100000:3.0:1789683397.217031:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850155264 00000100:00100000:3.0:1789683397.217045:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850155776 00000100:00100000:3.0:1789683397.217047:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850155776 00000100:00100000:3.0:1789683397.217058:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850156288 00000100:00100000:3.0:1789683397.217060:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850156288 00000100:00100000:3.0:1789683397.217072:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789683397.217077:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850155264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.217119:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850155264:12345-0@lo:400:kworker.0 Request processed in 42us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683397.217125:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789683397.217137:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789683397.217141:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850155776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.217164:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850155776:12345-0@lo:400:kworker.0 Request processed in 23us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683397.217169:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789683397.217178:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789683397.217183:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850156288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.217207:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850156288:12345-0@lo:400:kworker.0 Request processed in 24us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683397.217212:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1789683397.217227:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683397.217231:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789683397.217233:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683397.217253:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850155136:0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.217264:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850155648:0@lo:400:kworker.0 00010000:00080000:3.0:1789683397.217276:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83cae300 x1876618850156160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683397.217286:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850156160:0@lo:400:kworker.0 00010000:00080000:3.0:1789683397.217297:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83cac000 x1876618850156672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683397.217304:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850156672:0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.217324:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850155264:0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.217333:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850155776:0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.217341:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850156288:0@lo:400:kworker.0 00000100:00100000:3.0:1789683397.217376:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850155392:0@lo:400:kworker.0 00010000:00080000:3.0:1789683397.217389:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83cad500 x1876618850156032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683397.217397:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850156032:0@lo:400:kworker.0 00010000:00080000:3.0:1789683397.217405:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83cadf80 x1876618850156544/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683397.217413:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850156544:0@lo:400:kworker.0 00000100:00100000:2.0:1789683397.217884:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850156800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683397.217923:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683397.217997:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850156800 00000100:00100000:0.0:1789683397.218003:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850156800 00000100:00100000:0.0:1789683397.218036:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789683397.218043:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850156800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683397.218060:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683397.221744:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850156800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3692us (3811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683397.221759:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1789683397.224710:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f88cdd880 x1876618850156800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683397.224742:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850156800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789683397.663956:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683398.690063:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683399.194182:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683399.194222:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683399.194254:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683399.194397:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835404672 00000100:00100000:1.0:1789683399.194414:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835404672 00000100:00100000:1.0:1789683399.194470:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835404800 00000100:00100000:1.0:1789683399.194473:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835404800 00000100:00100000:1.0:1789683399.194494:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 111 00000100:00100000:1.0:1789683399.194502:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:2404:x1876618835404672:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683399.194581:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:2404:x1876618835404672:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 78us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683399.194594:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 111 00000100:00100000:1.0:1789683399.194618:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 112 00000100:00100000:1.0:1789683399.194624:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835404800:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683399.194660:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835404800:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 31us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683399.194667:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 112 00000100:00080000:0.0:1789683399.194738:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683399.194742:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683399.196085:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835404544 00000100:00100000:2.0:1789683399.196096:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835404544 00000100:00100000:2.0:1789683399.196153:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 289 00000100:00100000:2.0:1789683399.196162:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+10:2404:x1876618835404544:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683399.196212:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+10:2404:x1876618835404544:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 51us (1989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683399.196237:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 289 00000100:00100000:3.0:1789683399.271569:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683399.278053:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850156928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683399.278132:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683399.278727:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850156928 00000100:00100000:0.0:1789683399.278737:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850156928 00000100:00100000:0.0:1789683399.278800:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789683399.278809:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850156928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789683399.278846:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789683399.278900:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850156928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683399.278923:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789683399.278988:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850156928:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789683399.711336:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683399.774985:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683399.775009:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850157056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683399.775079:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683399.775162:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850157056 00000100:00100000:2.0:1789683399.775170:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850157056 00000100:00100000:2.0:1789683399.775228:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789683399.775239:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850157056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789683399.775272:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683399.775319:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850157056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683399.775326:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1789683399.775348:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789683399.775375:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d14000 x1876618850157056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683399.775394:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850157056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683400.287678:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850157184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683400.287753:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683400.287880:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850157184 00000100:00100000:2.0:1789683400.287889:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850157184 00000100:00100000:2.0:1789683400.287947:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789683400.287957:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850157184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683400.287989:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789683400.288035:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850157184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683400.288041:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789683400.288169:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850157184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683400.288525:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683400.288535:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850157312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683400.288579:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683400.288769:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850157312 00000100:00100000:3.0:1789683400.288774:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850157312 00000100:00100000:3.0:1789683400.288846:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789683400.288854:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850157312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683400.288871:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683400.288915:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850157312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683400.288921:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1789683400.288960:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f88cdd880 x1876618850157312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683400.288981:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850157312:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789683400.289091:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789683400.744837:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683401.760241:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683401.831972:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683401.831995:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850157440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683401.832079:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683401.832143:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850157440 00000100:00100000:1.0:1789683401.832150:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850157440 00000100:00100000:1.0:1789683401.832197:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789683401.832204:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850157440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789683401.832232:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683401.832271:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850157440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683401.832278:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1789683401.832297:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789683401.832326:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb79b5500 x1876618850157440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683401.832343:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850157440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789683402.335450:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850157568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683402.335523:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683402.335742:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850157568 00000100:00100000:3.0:1789683402.335752:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850157568 00000100:00080000:0.0:1789683402.336299:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789683402.336689:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789683402.336717:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850157568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683402.336744:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683402.336995:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850157568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 281us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683402.337003:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789683402.337194:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f88cdd880 x1876618850157568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683402.337216:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850157568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683402.337884:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850157696:0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.337953:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683402.337986:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850158208:0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.338274:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683402.338298:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850158720:0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.338320:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683402.338340:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789683402.338346:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850157824:0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.338440:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683402.338458:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1876618850158336:0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.338478:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683402.338493:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850158848:0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.338513:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683402.338552:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850157696 00000100:00100000:3.0:1789683402.338558:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850157696 00000100:00100000:3.0:1789683402.338598:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789683402.338605:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850157696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.338676:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850157696:12345-0@lo:400:kworker.0 Request processed in 58us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683402.338683:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789683402.338714:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850158720 00000100:00100000:3.0:1789683402.338718:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850158720 00000100:00100000:3.0:1789683402.338754:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789683402.338760:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850158720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.338985:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850158720:12345-0@lo:400:kworker.0 Request processed in 224us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683402.338992:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789683402.339273:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850157952:0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.339304:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683402.339327:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850158464:0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.339347:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683402.339446:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850158976:0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.339468:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683402.339483:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789683402.339490:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850158080:0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.339511:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683402.339522:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850158592:0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.339555:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683402.339575:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850159104:0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.339595:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683402.339622:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850157824 00000100:00100000:3.0:1789683402.339628:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850157824 00000100:00100000:3.0:1789683402.339656:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850158336 00000100:00100000:3.0:1789683402.339660:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850158336 00000100:00100000:3.0:1789683402.339687:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850158848 00000100:00100000:3.0:1789683402.339689:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850158848 00000100:00100000:3.0:1789683402.339699:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850158464 00000100:00100000:3.0:1789683402.339701:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850158464 00000100:00100000:3.0:1789683402.339713:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850158976 00000100:00100000:3.0:1789683402.339715:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850158976 00000100:00100000:3.0:1789683402.339726:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850158080 00000100:00100000:3.0:1789683402.339728:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850158080 00000100:00100000:3.0:1789683402.339740:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789683402.339747:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850157824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.339781:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850157824:12345-0@lo:400:kworker.0 Request processed in 34us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683402.339943:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789683402.339953:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876618850158336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683402.339991:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876618850158336:12345-0@lo:400:kworker.0 Request processed in 40us (1511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683402.339997:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789683402.340026:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789683402.340033:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850158848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683402.340058:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850158848:12345-0@lo:400:kworker.0 Request processed in 27us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683402.340072:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789683402.340084:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789683402.340090:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850158464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683402.340127:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850158464:12345-0@lo:400:kworker.0 Request processed in 37us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683402.340133:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789683402.340145:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789683402.340151:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850158976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683402.340322:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850158976:12345-0@lo:400:kworker.0 Request processed in 171us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683402.340328:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789683402.340339:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789683402.340344:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850158080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683402.340439:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850158080:12345-0@lo:400:kworker.0 Request processed in 94us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683402.340445:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789683402.340490:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850158080:0@lo:400:kworker.0 00010000:00080000:1.0:1789683402.340505:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83db6680 x1876618850158464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683402.340515:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850158464:0@lo:400:kworker.0 00010000:00080000:1.0:1789683402.340523:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83db4380 x1876618850158976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683402.340530:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850158976:0@lo:400:kworker.0 00000100:00100000:0.0:1789683402.340816:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850158208 00000100:00100000:0.0:1789683402.340821:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850158208 00000100:00100000:0.0:1789683402.340851:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850157952 00000100:00100000:0.0:1789683402.340854:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850157952 00000100:00100000:0.0:1789683402.340865:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789683402.340871:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850158208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683402.340917:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850158208:12345-0@lo:400:kworker.0 Request processed in 46us (2643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683402.340922:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789683402.340933:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789683402.340938:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850157952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683402.340970:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850157952:12345-0@lo:400:kworker.0 Request processed in 31us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683402.340975:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1789683402.340993:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683402.340996:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683402.340999:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683402.341151:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850157952:0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.341930:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789683402.341961:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850158592 00000100:00100000:3.0:1789683402.341966:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850158592 00000100:00100000:3.0:1789683402.342086:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850159104 00000100:00100000:3.0:1789683402.342090:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850159104 00000100:00100000:3.0:1789683402.342113:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789683402.342119:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850158592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.342503:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850158592:12345-0@lo:400:kworker.0 Request processed in 384us (2946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683402.342511:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789683402.342524:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789683402.342531:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850159104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.342561:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850159104:12345-0@lo:400:kworker.0 Request processed in 31us (2965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683402.342566:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789683402.342626:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850157824:0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.342638:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1876618850158336:0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.342650:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850158848:0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.342659:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850157696:0@lo:400:kworker.0 00000100:00100000:3.0:1789683402.342682:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850158208:0@lo:400:kworker.0 00010000:00080000:3.0:1789683402.342695:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83db5500 x1876618850158720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683402.342704:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850158720:0@lo:400:kworker.0 00000100:00080000:0.0:1789683402.343917:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789683402.349433:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83db6a00 x1876618850158592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683402.349452:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850158592:0@lo:400:kworker.0 00010000:00080000:0.0:1789683402.356848:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83db4e00 x1876618850159104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683402.356868:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850159104:0@lo:400:kworker.0 00010000:00010000:1.0:1789683402.788936:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683403.815135:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683404.308941:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683404.308995:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683404.309027:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683404.309126:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835405056 00000100:00100000:2.0:1789683404.309146:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835405056 00000100:00100000:2.0:1789683404.309205:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835405184 00000100:00100000:2.0:1789683404.309209:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835405184 00000100:00100000:2.0:1789683404.309230:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 119 00000100:00100000:2.0:1789683404.309240:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+6:2405:x1876618835405056:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683404.309313:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+6:2405:x1876618835405056:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 74us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683404.309332:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 119 00000100:00100000:2.0:1789683404.309350:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 120 00000100:00100000:2.0:1789683404.309356:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835405184:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683404.309380:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835405184:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683404.309386:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 120 00000100:00080000:0.0:1789683404.309442:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683404.309447:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683404.309594:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835404928 00000100:00100000:3.0:1789683404.309599:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835404928 00000100:00100000:3.0:1789683404.309635:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 291 00000100:00100000:3.0:1789683404.309642:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+10:2405:x1876618835404928:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683404.309681:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+10:2405:x1876618835404928:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 39us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683404.309687:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 291 00000100:00100000:0.0:1789683404.387287:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850159232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683404.387369:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683404.388029:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850159232 00000100:00100000:0.0:1789683404.388038:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850159232 00000100:00100000:0.0:1789683404.388083:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789683404.388092:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850159232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789683404.388130:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789683404.388181:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850159232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683404.388187:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789683404.388230:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850159232:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789683404.831179:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683404.896000:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683404.896022:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850159360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683404.896092:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683404.896159:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850159360 00000100:00100000:0.0:1789683404.896167:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850159360 00000100:00100000:0.0:1789683404.896216:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789683404.896225:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850159360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789683404.896262:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683404.896435:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850159360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683404.896445:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789683404.896466:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789683404.896492:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d15180 x1876618850159360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683404.896509:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850159360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683405.411085:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683405.411109:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850159488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683405.411202:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683405.411263:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850159488 00000100:00100000:1.0:1789683405.411271:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850159488 00000100:00100000:1.0:1789683405.412373:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789683405.412384:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850159488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683405.412409:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683405.412461:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850159488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683405.412467:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1789683405.412491:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789683405.412556:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb79b4380 x1876618850159488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683405.412576:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850159488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683405.416174:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850159616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683405.416254:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683405.416765:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850159616 00000100:00100000:3.0:1789683405.416775:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850159616 00000100:00100000:3.0:1789683405.416867:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789683405.416877:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850159616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789683405.416917:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789683405.425494:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850159616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8606us (9228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683405.425511:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789683405.442023:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850159616:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789683405.856519:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683406.884314:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683406.942994:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683406.943020:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850159744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683406.943096:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683406.943208:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850159744 00000100:00100000:1.0:1789683406.943217:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850159744 00000100:00100000:1.0:1789683406.943294:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789683406.943304:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850159744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789683406.943334:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683406.943409:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850159744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683406.943428:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1789683406.943665:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789683406.943697:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb79b4380 x1876618850159744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683406.943726:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850159744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683407.455179:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850160000:0@lo:400:kworker.0 00000100:00100000:1.0:1789683407.455200:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850160256:0@lo:400:kworker.0 00000100:00100000:0.0:1789683407.455283:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850160128:0@lo:400:kworker.0 00000100:00100000:2.0:1789683407.455425:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850159872:0@lo:400:kworker.0 00000100:00100000:1.0:1789683407.459332:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683407.459700:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850160768:0@lo:400:kworker.0 00000100:00100000:1.0:1789683407.459750:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683407.459778:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850161280:0@lo:400:kworker.0 00000100:00100000:1.0:1789683407.459825:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683407.459879:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850160256 00000100:00100000:1.0:1789683407.459888:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850160256 00000100:00100000:1.0:1789683407.459937:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789683407.459945:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850160256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683407.460000:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850160256:12345-0@lo:400:kworker.0 Request processed in 56us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683407.460006:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789683407.460028:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850160768 00000100:00100000:1.0:1789683407.460031:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850160768 00000100:00100000:1.0:1789683407.460063:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850161280 00000100:00100000:1.0:1789683407.460066:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850161280 00000100:00100000:1.0:1789683407.460094:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789683407.460102:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850160768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683407.460132:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850160768:12345-0@lo:400:kworker.0 Request processed in 32us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683407.460137:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789683407.460148:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789683407.460154:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850161280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683407.460200:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850161280:12345-0@lo:400:kworker.0 Request processed in 46us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683407.460206:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1789683407.460229:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683407.460259:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850160256:0@lo:400:kworker.0 00010000:00080000:1.0:1789683407.460271:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83c61c00 x1876618850160768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683407.460281:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850160768:0@lo:400:kworker.0 00010000:00080000:1.0:1789683407.460289:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83c62680 x1876618850161280/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683407.460297:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850161280:0@lo:400:kworker.0 00000100:00100000:0.0:1789683407.462250:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683407.462307:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850160640:0@lo:400:kworker.0 00000100:00100000:2.0:1789683407.462539:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683407.462575:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850160384:0@lo:400:kworker.0 00000100:00100000:2.0:1789683407.462598:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683407.462619:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850160896:0@lo:400:kworker.0 00000100:00100000:2.0:1789683407.462640:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683407.462661:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850161408:0@lo:400:kworker.0 00000100:00100000:2.0:1789683407.462680:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683407.462728:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850160128 00000100:00100000:2.0:1789683407.462738:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850160128 00000100:00100000:2.0:1789683407.462781:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850160384 00000100:00100000:2.0:1789683407.462809:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850160384 00000100:00100000:2.0:1789683407.462828:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789683407.462837:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850160128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683407.462850:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683407.462893:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850160000 00000100:00100000:3.0:1789683407.462898:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850160000 00000100:00100000:2.0:1789683407.462899:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850160128:12345-0@lo:400:kworker.0 Request processed in 62us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683407.462908:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789683407.462928:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789683407.462935:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789683407.462938:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850160384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683407.462949:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850160000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683407.462976:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850160384:12345-0@lo:400:kworker.0 Request processed in 41us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683407.462982:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789683407.463004:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850160896 00000100:00100000:2.0:1789683407.463021:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850160896 00000100:00100000:2.0:1789683407.463061:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850161408 00000100:00100000:2.0:1789683407.463064:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850161408 00000100:00100000:3.0:1789683407.463069:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850160000:12345-0@lo:400:kworker.0 Request processed in 124us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683407.463078:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789683407.463117:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850160000:0@lo:400:kworker.0 00000100:00100000:3.0:1789683407.463125:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850160512:0@lo:400:kworker.0 00000100:00100000:3.0:1789683407.463145:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683407.463161:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850161024:0@lo:400:kworker.0 00000100:00100000:2.0:1789683407.463175:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789683407.463182:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683407.463187:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850160896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683407.463210:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850161536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683407.463227:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850160896:12345-0@lo:400:kworker.0 Request processed in 43us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683407.463233:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789683407.463245:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789683407.463250:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850161408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683407.463292:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850161408:12345-0@lo:400:kworker.0 Request processed in 26us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683407.463299:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1789683407.463319:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683407.463323:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683407.463343:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850160384:0@lo:400:kworker.0 00010000:00080000:2.0:1789683407.463355:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83c63800 x1876618850160896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683407.463507:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850160512 00000100:00100000:1.0:1789683407.463512:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850160512 00000100:00100000:0.0:1789683407.463543:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850159872 00000100:00100000:1.0:1789683407.463546:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850161024 00000100:00100000:0.0:1789683407.463550:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850159872 00000100:00100000:1.0:1789683407.463551:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850161024 00000100:00100000:1.0:1789683407.463570:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789683407.463578:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850160512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683407.463591:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789683407.463600:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850159872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683407.463617:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850160512:12345-0@lo:400:kworker.0 Request processed in 40us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683407.463623:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789683407.463638:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789683407.463647:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850159872:12345-0@lo:400:kworker.0 Request processed in 47us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683407.463648:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850161024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683407.463660:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789683407.463686:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850161024:12345-0@lo:400:kworker.0 Request processed in 41us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683407.463693:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789683407.463698:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683407.463715:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850160640 00000100:00100000:1.0:1789683407.463719:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850160640 00000100:00100000:0.0:1789683407.463731:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850161152:0@lo:400:kworker.0 00000100:00100000:1.0:1789683407.463738:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789683407.463758:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683407.463817:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850160128:0@lo:400:kworker.0 00000100:00100000:1.0:1789683407.463841:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850160640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683407.463857:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850161152 00000100:00100000:0.0:1789683407.463861:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850161152 00000100:00100000:1.0:1789683407.463885:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850160640:12345-0@lo:400:kworker.0 Request processed in 140us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683407.463890:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789683407.463897:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789683407.463902:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850161152:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789683407.463932:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83c60a80 x1876618850160640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683407.463942:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850161152:12345-0@lo:400:kworker.0 Request processed in 43us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683407.463944:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850160640:0@lo:400:kworker.0 00000100:00100000:0.0:1789683407.463957:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:1.0:1789683407.463964:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83c60700 x1876618850161152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789683407.464073:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683407.464076:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683407.464195:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850160896:0@lo:400:kworker.0 00010000:00080000:2.0:1789683407.464212:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83c62a00 x1876618850161408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683407.464221:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850161408:0@lo:400:kworker.0 00000100:00100000:2.0:1789683407.464239:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850159872:0@lo:400:kworker.0 00000100:00100000:3.0:1789683407.464930:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683407.465621:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850161152:0@lo:400:kworker.0 00000100:00100000:3.0:1789683407.465917:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850160512:0@lo:400:kworker.0 00000100:00100000:3.0:1789683407.465932:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850161024:0@lo:400:kworker.0 00000100:00100000:2.0:1789683407.467591:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850161536 00000100:00100000:2.0:1789683407.467609:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850161536 00000100:00100000:2.0:1789683407.467712:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789683407.467723:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850161536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683407.467754:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683407.467867:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850161536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (2937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683407.467874:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1789683407.468512:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d15180 x1876618850161536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683407.468536:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850161536:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789683407.904359:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789683408.876388:0:11999:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 18:16:47 (1789683407) === 00010000:00010000:0.0:1789683408.931171:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683409.288278:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683409.290962:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835405312 00000100:00100000:3.0:1789683409.290980:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835405312 00000100:00100000:3.0:1789683409.291202:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 293 00000100:00100000:3.0:1789683409.291214:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+10:8723:x1876618835405312:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789683409.291234:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683409.291254:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81390a00/0xcf8485587b88970f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc44f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.291304:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81390a00/0xcf8485587b88970f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc44f expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.291315:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81390a00/0xcf8485587b88970f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc44f expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.291325:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81390a00, rc 0) 00000100:00100000:3.0:1789683409.291465:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+11:8723:x1876618835405312:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 252us (3196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.291472:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 293 00000100:00100000:0.0:1789683409.297403:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683409.297688:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835405440 00000100:00100000:3.0:1789683409.297699:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835405440 00000100:00100000:3.0:1789683409.297819:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 294 00000100:00100000:3.0:1789683409.297832:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+11:8723:x1876618835405440:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789683409.298131:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+11:8723:x1876618835405440:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 300us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.298140:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 294 00000100:00100000:1.0:1789683409.301468:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683409.301614:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835405568 00000100:00100000:3.0:1789683409.301624:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835405568 00000100:00100000:3.0:1789683409.301681:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 295 00000100:00100000:3.0:1789683409.301691:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+11:8723:x1876618835405568:12345-192.168.201.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789683409.301872:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+11:8723:x1876618835405568:12345-192.168.201.50@tcp:503:mount.lustre.0 Request processed in 181us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.301881:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 295 00000100:00100000:2.0:1789683409.305277:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683409.305367:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835405696 00000100:00100000:3.0:1789683409.305391:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835405696 00000100:00100000:3.0:1789683409.305446:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 296 00000100:00100000:3.0:1789683409.305466:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+11:8727:x1876618835405696:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789683409.305616:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+11:8727:x1876618835405696:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 152us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.305624:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 296 00000100:00100000:2.0:1789683409.334250:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683409.334397:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835405824 00000100:00100000:0.0:1789683409.334407:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835405824 00000100:00100000:0.0:1789683409.334471:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 297 00000100:00100000:0.0:1789683409.334482:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+11:8727:x1876618835405824:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789683409.334635:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+11:8727:x1876618835405824:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 154us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683409.334643:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 297 00000100:00100000:1.0:1789683409.341776:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683409.342439:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835405952 00000100:00100000:2.0:1789683409.342457:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835405952 00000100:00100000:2.0:1789683409.342513:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 298 00000100:00100000:2.0:1789683409.342524:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+11:8727:x1876618835405952:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789683409.342677:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+11:8727:x1876618835405952:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 154us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683409.342685:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 298 00000100:00100000:2.0:1789683409.348393:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683409.348577:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835406080 00000100:00100000:3.0:1789683409.348588:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835406080 00000100:00100000:3.0:1789683409.348647:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 299 00000100:00100000:3.0:1789683409.348659:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+11:8723:x1876618835406080:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789683409.348677:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683409.348695:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81390e00/0xcf8485587b889716 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc480 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.348726:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81390e00/0xcf8485587b889716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc480 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.348738:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81390e00/0xcf8485587b889716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc480 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.348748:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81390e00, rc 0) 00000100:00100000:3.0:1789683409.348957:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+12:8723:x1876618835406080:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 300us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.348966:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 299 00000100:00100000:3.0:1789683409.352239:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683409.352388:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835406208 00000100:00100000:0.0:1789683409.352413:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835406208 00000100:00100000:0.0:1789683409.352481:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 300 00000100:00100000:0.0:1789683409.352491:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+12:8723:x1876618835406208:12345-192.168.201.50@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789683409.352517:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789683409.352535:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789683409.352539:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789683409.352542:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789683409.352545:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789683409.352548:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789683409.354808:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+12:8723:x1876618835406208:12345-192.168.201.50@tcp:256:mount.lustre.0 Request processed in 2284us (2553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683409.354824:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 300 00000100:00100000:1.0:1789683409.357371:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683409.357628:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835406336 00000100:00100000:3.0:1789683409.357639:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835406336 00000100:00100000:3.0:1789683409.357713:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 301 00000100:00100000:3.0:1789683409.357723:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+12:8723:x1876618835406336:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789683409.357741:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683409.357758:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81391a00/0xcf8485587b88971d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc487 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.357857:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81391a00/0xcf8485587b88971d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc487 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.357868:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81391a00/0xcf8485587b88971d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc487 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.357877:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81391a00, rc 0) 00000100:00100000:3.0:1789683409.358080:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:8723:x1876618835406336:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 358us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.358087:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 301 00000100:00100000:3.0:1789683409.360755:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683409.360928:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835406464 00000100:00100000:0.0:1789683409.360937:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835406464 00000100:00100000:0.0:1789683409.361036:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 302 00000100:00100000:0.0:1789683409.361047:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:8723:x1876618835406464:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789683409.361205:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:8723:x1876618835406464:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 160us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683409.361212:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 302 00000100:00100000:1.0:1789683409.363524:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683409.363614:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835406592 00000100:00100000:3.0:1789683409.363624:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835406592 00000100:00100000:3.0:1789683409.363678:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 303 00000100:00100000:3.0:1789683409.363688:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:8723:x1876618835406592:12345-192.168.201.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789683409.363873:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:8723:x1876618835406592:12345-192.168.201.50@tcp:503:mount.lustre.0 Request processed in 185us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.363880:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 303 00000100:00100000:1.0:1789683409.366643:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683409.367104:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835406720 00000100:00100000:3.0:1789683409.367116:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835406720 00000100:00100000:3.0:1789683409.367161:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 304 00000100:00100000:3.0:1789683409.367171:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:8730:x1876618835406720:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789683409.367348:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:8730:x1876618835406720:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 177us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.367356:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 304 00000100:00100000:1.0:1789683409.378585:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683409.378672:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835406848 00000100:00100000:3.0:1789683409.378683:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835406848 00000100:00100000:3.0:1789683409.378740:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 305 00000100:00100000:3.0:1789683409.378750:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:8730:x1876618835406848:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789683409.378946:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:8730:x1876618835406848:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 196us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.378953:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 305 00000100:00100000:1.0:1789683409.382408:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683409.382442:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683409.382481:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683409.382502:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683409.382738:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835407104 00000100:00100000:3.0:1789683409.382748:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835407104 00000100:00100000:0.0:1789683409.382817:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835407232 00000100:00100000:0.0:1789683409.382822:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835407232 00000100:00100000:3.0:1789683409.382842:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835407488 00000100:00100000:0.0:1789683409.382842:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835406976 00000100:00100000:3.0:1789683409.382845:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835407488 00000100:00100000:0.0:1789683409.382845:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835406976 00000100:00100000:0.0:1789683409.382858:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 127 00000100:00100000:0.0:1789683409.382869:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835407104:12345-192.168.201.50@tcp:400:kworker.0 00000100:00080000:2.0:1789683409.382933:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789683409.382937:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683409.382943:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835407104:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 77us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.387719:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:3.0:1789683409.387735:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1876618835406976:12345-192.168.201.50@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789683409.387801:0:6522:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 13ee1651-c170-427a-b389-1f9d341ed790@192.168.201.50@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:3.0:1789683409.387845:0:6522:0:(genops.c:1384:class_connect()) connect: client 13ee1651-c170-427a-b389-1f9d341ed790, cookie 0xcf8485587b889724 00000004:00100000:3.0:1789683409.387875:0:6522:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1789683409.388002:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9f0fc148a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683409.389519:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13ee1651-c170-427a-b389-1f9d341ed790+6:2401:x1876618835406976:12345-192.168.201.50@tcp:38:mount.lustre.0 Request processed in 1494us (6744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.389534:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:3.0:1789683409.389571:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 128 00000100:00100000:3.0:1789683409.389583:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835407232:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683409.389646:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835407232:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 67us (7203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.389653:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 128 00000100:00100000:3.0:1789683409.389667:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:3.0:1789683409.389672:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1876618835407488:12345-192.168.201.50@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789683409.389694:0:6522:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 13ee1651-c170-427a-b389-1f9d341ed790@192.168.201.50@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:3.0:1789683409.389726:0:6522:0:(genops.c:1384:class_connect()) connect: client 13ee1651-c170-427a-b389-1f9d341ed790, cookie 0xcf8485587b88972b 00000004:00100000:3.0:1789683409.389748:0:6522:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:3.0:1789683409.389913:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9f0fc148c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683409.389940:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13ee1651-c170-427a-b389-1f9d341ed790+6:2401:x1876618835407488:12345-192.168.201.50@tcp:38:mount.lustre.0 Request processed in 266us (7436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.389947:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:0.0:1789683409.398013:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 127 00000100:00100000:1.0:1789683409.407158:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683409.407391:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835407744 00000100:00100000:3.0:1789683409.407404:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835407744 00000100:00100000:3.0:1789683409.407495:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:3.0:1789683409.407506:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13ee1651-c170-427a-b389-1f9d341ed790+6:8723:x1876618835407744:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789683409.407544:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789683409.407646:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13ee1651-c170-427a-b389-1f9d341ed790+6:8723:x1876618835407744:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 142us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.407655:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00080000:2.0:1789683409.407831:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683409.411143:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683409.411193:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683409.411303:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835407616 00000100:00100000:2.0:1789683409.411312:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835407616 00000100:00100000:2.0:1789683409.411386:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835407360 00000100:00100000:2.0:1789683409.411390:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835407360 00000100:00100000:2.0:1789683409.411411:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:2.0:1789683409.411420:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+6:0:x1876618835407616:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789683409.411490:0:8462:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789683409.411577:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+6:0:x1876618835407616:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 157us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683409.411584:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:2.0:1789683409.411605:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:2.0:1789683409.411612:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+6:0:x1876618835407360:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789683409.411623:0:8462:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789683409.411650:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+6:0:x1876618835407360:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 40us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683409.411655:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00080000:0.0:1789683409.412709:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789683409.416445:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683409.416657:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835407872 00000100:00100000:2.0:1789683409.416665:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835407872 00000100:00100000:2.0:1789683409.416717:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:2.0:1789683409.416726:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+6:8723:x1876618835407872:12345-192.168.201.50@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789683409.416834:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+6:8723:x1876618835407872:12345-192.168.201.50@tcp:40:mount.lustre.0 Request processed in 108us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683409.416841:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:1.0:1789683409.419505:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683409.419604:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835408000 00000100:00100000:2.0:1789683409.419614:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835408000 00000100:00100000:2.0:1789683409.419664:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:2.0:1789683409.419673:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1876618835408000:12345-192.168.201.50@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789683409.419708:0:8676:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 13ee1651-c170-427a-b389-1f9d341ed790@192.168.201.50@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:2.0:1789683409.419738:0:8676:0:(genops.c:1384:class_connect()) connect: client 13ee1651-c170-427a-b389-1f9d341ed790, cookie 0xcf8485587b889732 00002000:00100000:2.0:1789683409.419750:0:8676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 13ee1651-c170-427a-b389-1f9d341ed790/ffff9f0e83443800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789683409.419833:0:8676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1789683409.419920:0:8676:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789683409.419958:0:8676:0:(import.c:65:import_set_state_nolock()) ffff9f0e83445800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789683409.420031:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:13ee1651-c170-427a-b389-1f9d341ed790+6:2401:x1876618835408000:12345-192.168.201.50@tcp:8:mount.lustre.0 Request processed in 357us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683409.420039:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:0.0:1789683409.422887:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683409.422947:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683409.423031:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835408256 00000100:00100000:3.0:1789683409.423041:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835408256 00000100:00100000:3.0:1789683409.423105:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:3.0:1789683409.423117:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:13ee1651-c170-427a-b389-1f9d341ed790+6:8723:x1876618835408256:12345-192.168.201.50@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789683409.423223:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:13ee1651-c170-427a-b389-1f9d341ed790+6:8723:x1876618835408256:12345-192.168.201.50@tcp:900:mount.lustre.0 Request processed in 108us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.423240:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:2.0:1789683409.423870:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835408128 00000100:00100000:2.0:1789683409.423878:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835408128 00000100:00100000:2.0:1789683409.423918:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:2.0:1789683409.423925:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1876618835408128:12345-192.168.201.50@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789683409.423955:0:8437:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 13ee1651-c170-427a-b389-1f9d341ed790@192.168.201.50@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:2.0:1789683409.423991:0:8437:0:(genops.c:1384:class_connect()) connect: client 13ee1651-c170-427a-b389-1f9d341ed790, cookie 0xcf8485587b889739 00002000:00100000:2.0:1789683409.424006:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 13ee1651-c170-427a-b389-1f9d341ed790/ffff9f0e83445000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789683409.424028:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1789683409.424105:0:8437:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789683409.424135:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9f0e83447800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789683409.424189:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13ee1651-c170-427a-b389-1f9d341ed790+6:2401:x1876618835408128:12345-192.168.201.50@tcp:8:mount.lustre.0 Request processed in 263us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683409.424197:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:0.0:1789683409.427380:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683409.427482:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835408384 00000100:00100000:3.0:1789683409.427492:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835408384 00000100:00100000:3.0:1789683409.427554:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:3.0:1789683409.427565:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13ee1651-c170-427a-b389-1f9d341ed790+6:8723:x1876618835408384:12345-192.168.201.50@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789683409.427678:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789683409.427777:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13ee1651-c170-427a-b389-1f9d341ed790+6:8723:x1876618835408384:12345-192.168.201.50@tcp:33:mount.lustre.0 Request processed in 213us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.427825:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:3.0:1789683409.506268:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683409.506289:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850161664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683409.506352:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683409.506475:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850161664 00000100:00100000:2.0:1789683409.506483:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850161664 00000100:00100000:2.0:1789683409.506534:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789683409.506542:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850161664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789683409.506568:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789683409.506617:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850161664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683409.506636:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789683409.506712:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850161664:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789683409.951387:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683410.015161:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683410.015594:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850161792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683410.015677:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683410.018340:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850161792 00000100:00100000:2.0:1789683410.018356:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850161792 00000100:00100000:2.0:1789683410.018578:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789683410.018591:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850161792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789683410.018616:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683410.018713:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850161792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (3036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683410.018720:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1789683410.019233:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d15180 x1876618850161792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683410.019255:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850161792:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789683410.022176:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683410.527806:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850161920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683410.527885:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683410.527956:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850161920 00000100:00100000:0.0:1789683410.527964:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850161920 00000100:00100000:0.0:1789683410.528012:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789683410.528022:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa50b6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850161920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789683410.528072:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789683410.528470:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa50b6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850161920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 448us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683410.528478:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789683410.528925:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850161920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789683410.529119:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683410.529676:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850162048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683410.529723:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683410.529871:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850162048 00000100:00100000:3.0:1789683410.529879:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850162048 00000100:00100000:3.0:1789683410.529934:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789683410.529943:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850162048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683410.529961:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683410.530002:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850162048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683410.530010:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1789683410.530187:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789683410.530364:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc070dc00 x1876618850162048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683410.530382:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850162048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789683410.979097:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683412.003149:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683412.064537:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850162176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683412.064629:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683412.064769:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850162176 00000100:00100000:0.0:1789683412.064778:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850162176 00000100:00100000:0.0:1789683412.064872:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789683412.064883:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850162176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789683412.065471:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683412.065558:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850162176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 677us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683412.065566:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1789683412.065632:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789683412.065764:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83db4e00 x1876618850162176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683412.065824:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850162176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683412.577373:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850162304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683412.577467:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683412.577547:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850162304 00000100:00100000:3.0:1789683412.577555:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850162304 00000100:00100000:3.0:1789683412.577607:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789683412.577615:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850162304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683412.577638:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683412.577681:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850162304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683412.577688:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1789683412.577723:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789683412.577752:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83c61180 x1876618850162304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683412.577769:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850162304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683412.578423:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850162432:0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.578475:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683412.578511:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850162944:0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.578586:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683412.578605:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850163456:0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.578630:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683412.578652:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789683412.578658:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850162816:0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.578693:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683412.578722:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850163328:0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.578743:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683412.578769:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850162560:0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.578818:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683412.578836:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850163072:0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.578854:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683412.578871:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850163584:0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.578889:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683412.578904:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789683412.578910:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850162688:0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.578930:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683412.578949:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850163200:0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.578967:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683412.578978:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850163712:0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.578996:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683412.579023:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850162944 00000100:00100000:3.0:1789683412.579029:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850162944 00000100:00100000:3.0:1789683412.579067:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850162688 00000100:00100000:3.0:1789683412.579071:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850162688 00000100:00100000:3.0:1789683412.579086:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789683412.579093:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850162944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.579146:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850162944:12345-0@lo:400:kworker.0 Request processed in 54us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683412.579153:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789683412.579189:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789683412.579195:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850162688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.579229:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850162688:12345-0@lo:400:kworker.0 Request processed in 35us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683412.579234:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789683412.579254:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850163456 00000100:00100000:3.0:1789683412.579258:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850163456 00000100:00100000:3.0:1789683412.579288:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850163328 00000100:00100000:3.0:1789683412.579291:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850163328 00000100:00100000:3.0:1789683412.579311:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789683412.579317:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850163456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.579346:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850163456:12345-0@lo:400:kworker.0 Request processed in 29us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683412.579352:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789683412.579363:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789683412.579368:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850163328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.579394:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850163328:12345-0@lo:400:kworker.0 Request processed in 26us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683412.579399:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789683412.579415:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850162816 00000100:00100000:3.0:1789683412.579418:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850162816 00000100:00100000:3.0:1789683412.579435:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850162560 00000100:00100000:3.0:1789683412.579438:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850162560 00000100:00100000:3.0:1789683412.579449:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850163072 00000100:00100000:3.0:1789683412.579451:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850163072 00000100:00100000:3.0:1789683412.579465:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850163584 00000100:00100000:3.0:1789683412.579467:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850163584 00000100:00100000:3.0:1789683412.579478:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850163200 00000100:00100000:3.0:1789683412.579481:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850163200 00000100:00100000:3.0:1789683412.579500:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850163712 00000100:00100000:3.0:1789683412.579503:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850163712 00000100:00100000:3.0:1789683412.579515:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789683412.579520:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850162816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.579548:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850162816:12345-0@lo:400:kworker.0 Request processed in 28us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683412.579553:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789683412.579564:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789683412.579568:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850162560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.579590:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850162560:12345-0@lo:400:kworker.0 Request processed in 21us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683412.579595:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789683412.579604:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789683412.579609:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850163072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.579630:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850163072:12345-0@lo:400:kworker.0 Request processed in 22us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683412.579636:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789683412.579644:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789683412.579649:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850163584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.579669:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850163584:12345-0@lo:400:kworker.0 Request processed in 21us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683412.579674:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789683412.579683:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789683412.579689:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850163200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.579724:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850163200:12345-0@lo:400:kworker.0 Request processed in 35us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683412.579735:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789683412.579748:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789683412.579753:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850163712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.579781:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850163712:12345-0@lo:400:kworker.0 Request processed in 28us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683412.579808:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1789683412.579843:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789683412.579847:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683412.579849:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683412.579895:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850162688:0@lo:400:kworker.0 00010000:00080000:3.0:1789683412.579908:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83db6680 x1876618850163200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683412.579917:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850163200:0@lo:400:kworker.0 00010000:00080000:3.0:1789683412.579926:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83db6d80 x1876618850163712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683412.579933:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850163712:0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.579942:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850162560:0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.579950:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850163072:0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.579958:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850163584:0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.579991:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850162816:0@lo:400:kworker.0 00010000:00080000:3.0:1789683412.580001:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83db7800 x1876618850163328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683412.580021:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850163328:0@lo:400:kworker.0 00000100:00100000:3.0:1789683412.580032:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850162944:0@lo:400:kworker.0 00010000:00080000:3.0:1789683412.580041:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83db4e00 x1876618850163456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683412.580048:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850163456:0@lo:400:kworker.0 00000100:00100000:1.0:1789683412.580297:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850162432 00000100:00100000:1.0:1789683412.580303:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850162432 00000100:00100000:1.0:1789683412.580345:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789683412.580352:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850162432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683412.580391:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850162432:12345-0@lo:400:kworker.0 Request processed in 40us (1916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683412.580397:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789683412.581562:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850162432:0@lo:400:kworker.0 00010000:00010000:0.0:1789683413.023333:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683414.050562:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683414.556311:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683414.556385:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683414.556422:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683414.556588:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683414.556619:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683414.558845:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835408512 00000100:00100000:2.0:1789683414.558870:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835408512 00000100:00100000:2.0:1789683414.558973:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 307 00000100:00100000:2.0:1789683414.558988:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:2402:x1876618835408512:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683414.559105:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:2402:x1876618835408512:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 120us (2815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683414.559137:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 307 00000100:00100000:2.0:1789683414.562095:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835409280 00000100:00100000:2.0:1789683414.562120:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835409280 00000100:00100000:2.0:1789683414.562256:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:2.0:1789683414.562269:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:13ee1651-c170-427a-b389-1f9d341ed790+6:2402:x1876618835409280:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683414.562390:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:13ee1651-c170-427a-b389-1f9d341ed790+6:2402:x1876618835409280:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 123us (5801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683414.562398:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00080000:2.0:1789683414.562426:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683414.569652:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683414.576579:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835408768 00000100:00100000:0.0:1789683414.576604:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835408768 00000100:00100000:0.0:1789683414.576739:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835409024 00000100:00100000:0.0:1789683414.576743:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835409024 00000100:00100000:0.0:1789683414.576761:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835408640 00000100:00100000:0.0:1789683414.576765:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835408640 00000100:00100000:0.0:1789683414.576807:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 135 00000100:00100000:0.0:1789683414.576821:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835408768:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683414.576958:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835408768:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 140us (20571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683414.576967:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 135 00000100:00100000:0.0:1789683414.576989:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 136 00000100:00100000:0.0:1789683414.576995:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+6:2402:x1876618835409024:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683414.577022:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+6:2402:x1876618835409024:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 27us (20600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683414.577028:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 136 00000100:00100000:0.0:1789683414.577038:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 137 00000100:00100000:0.0:1789683414.577044:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835408640:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683414.577067:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835408640:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 24us (20447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683414.577072:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 137 00000100:00080000:0.0:1789683414.577131:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683414.577136:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683414.592804:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683414.594605:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835408896 00000100:00100000:3.0:1789683414.594627:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835408896 00000100:00100000:3.0:1789683414.594748:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 138 00000100:00100000:3.0:1789683414.594762:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+6:2402:x1876618835408896:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683414.594909:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+6:2402:x1876618835408896:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 151us (25273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683414.594918:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 138 00000100:00100000:3.0:1789683414.594952:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835409152 00000100:00100000:3.0:1789683414.594957:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835409152 00000100:00100000:3.0:1789683414.594994:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:3.0:1789683414.595000:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13ee1651-c170-427a-b389-1f9d341ed790+6:2402:x1876618835409152:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683414.595030:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13ee1651-c170-427a-b389-1f9d341ed790+6:2402:x1876618835409152:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 30us (2259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683414.595036:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00080000:3.0:1789683414.595135:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789683414.595141:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683414.638560:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683414.638592:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850163840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683414.638713:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683414.638840:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850163840 00000100:00100000:1.0:1789683414.638850:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850163840 00000100:00100000:1.0:1789683414.638908:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789683414.638918:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850163840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683414.638967:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789683414.639022:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850163840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683414.639049:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789683414.639108:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850163840:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789683415.073590:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683415.150340:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683415.150396:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850163968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683415.150500:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683415.150936:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850163968 00000100:00100000:0.0:1789683415.150949:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850163968 00000100:00100000:0.0:1789683415.151042:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789683415.151056:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850163968:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789683415.151250:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789683415.151348:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683415.151438:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850163968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 385us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683415.151447:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1789683415.151543:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc070d880 x1876618850163968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683415.151566:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850163968:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1789683415.165028:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 13ee1651-c170-427a-b389-1f9d341ed790 00000001:00100000:3.0:1789683415.165697:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 13ee1651-c170-427a-b389-1f9d341ed790 00000001:00100000:3.0:1789683415.165949:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 13ee1651-c170-427a-b389-1f9d341ed790 00000001:00100000:2.0:1789683415.167501:0:7455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 13ee1651-c170-427a-b389-1f9d341ed790 00000001:02000400:1.0:1789683415.551372:0:12192:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1789683415.648422:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850164096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789683415.649857:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683415.653134:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850164096 00000100:00100000:1.0:1789683415.653155:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850164096 00000100:00100000:1.0:1789683415.653267:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789683415.653280:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8374ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850164096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683415.653334:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789683415.660250:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850164224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683415.660371:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683415.660485:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850164224 00000100:00100000:2.0:1789683415.660496:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850164224 00000100:00100000:2.0:1789683415.660599:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789683415.660624:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850164224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789683415.660668:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683415.660735:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850164224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683415.660742:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789683415.660773:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789683415.660835:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc070ea00 x1876618850164224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683415.660895:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850164224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683415.667240:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8374ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850164096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 13948us (17377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683415.667262:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789683415.674596:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850164096:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789683416.097877:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683417.119494:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683417.193544:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850164352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683417.193633:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683417.193713:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850164352 00000100:00100000:3.0:1789683417.193721:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850164352 00000100:00100000:3.0:1789683417.193779:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789683417.193807:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850164352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789683417.193838:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683417.193884:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850164352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683417.193892:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1789683417.193913:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789683417.193945:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83748e00 x1876618850164352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683417.193963:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850164352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683417.695347:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850164608:0@lo:400:kworker.0 00000100:00100000:1.0:1789683417.695418:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683417.695719:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850164480:0@lo:400:kworker.0 00000100:00100000:2.0:1789683417.695761:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683417.695827:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850164992:0@lo:400:kworker.0 00000100:00100000:2.0:1789683417.695853:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683417.695872:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850165504:0@lo:400:kworker.0 00000100:00100000:2.0:1789683417.695894:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683417.695920:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789683417.695926:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850164864:0@lo:400:kworker.0 00000100:00100000:2.0:1789683417.695966:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850164736:0@lo:400:kworker.0 00000100:00100000:2.0:1789683417.695988:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683417.696007:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850165248:0@lo:400:kworker.0 00000100:00100000:2.0:1789683417.696034:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850164480 00000100:00100000:2.0:1789683417.696042:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850164480 00000100:00100000:2.0:1789683417.696092:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789683417.696101:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850164480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683417.696351:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850165120:0@lo:400:kworker.0 00000100:00100000:1.0:1789683417.696375:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683417.696427:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850164480:12345-0@lo:400:kworker.0 Request processed in 326us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683417.696434:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789683417.696470:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850164992 00000100:00100000:2.0:1789683417.696476:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850164992 00000100:00100000:2.0:1789683417.696502:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850164736 00000100:00100000:2.0:1789683417.696524:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850164736 00000100:00100000:2.0:1789683417.696541:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789683417.696548:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850164992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683417.696582:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850164992:12345-0@lo:400:kworker.0 Request processed in 35us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683417.696588:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789683417.696598:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789683417.696604:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850164736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683417.696642:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850164736:12345-0@lo:400:kworker.0 Request processed in 38us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683417.696648:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789683417.696667:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850165504 00000100:00100000:2.0:1789683417.696670:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850165504 00000100:00100000:2.0:1789683417.696703:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789683417.696709:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8374b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850165504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683417.696741:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8374b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850165504:12345-0@lo:400:kworker.0 Request processed in 32us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683417.696746:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1789683417.696770:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683417.700520:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683417.700558:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850166016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683417.700643:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683417.700755:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850166016 00000100:00100000:2.0:1789683417.700764:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850166016 00000100:00100000:2.0:1789683417.700871:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789683417.700880:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850166016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683417.700906:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683417.700964:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850166016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683417.700971:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1789683417.701181:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789683417.701214:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e8374b480 x1876618850166016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683417.701234:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850166016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683417.706385:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683417.706432:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850164608 00000100:00100000:0.0:1789683417.706443:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850164608 00000100:00100000:0.0:1789683417.706538:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850165632:0@lo:400:kworker.0 00000100:00100000:3.0:1789683417.709515:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850165120 00000100:00100000:3.0:1789683417.709532:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850165120 00000100:00100000:3.0:1789683417.709596:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789683417.709606:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850164608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683417.709717:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850164608:12345-0@lo:400:kworker.0 Request processed in 112us (14298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683417.709891:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789683417.709912:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789683417.710187:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850165760:0@lo:400:kworker.0 00000100:00080000:0.0:1789683417.710189:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683417.710206:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683417.710224:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683417.710249:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850164736:0@lo:400:kworker.0 00000100:00100000:0.0:1789683417.710249:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850164608:0@lo:400:kworker.0 00000100:00100000:1.0:1789683417.710274:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850165248 00000100:00100000:1.0:1789683417.710279:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850165248 00000100:00100000:1.0:1789683417.710308:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850165632 00000100:00100000:1.0:1789683417.710311:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850165632 00000100:00100000:1.0:1789683417.710322:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850165760 00000100:00100000:1.0:1789683417.710325:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850165760 00000100:00100000:1.0:1789683417.710356:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789683417.710362:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850165248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683417.710373:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683417.710393:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850165376:0@lo:400:kworker.0 00000100:00100000:1.0:1789683417.710399:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850165248:12345-0@lo:400:kworker.0 Request processed in 38us (4023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683417.710404:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789683417.710417:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850164864 00000100:00100000:1.0:1789683417.710421:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850164864 00000100:00100000:0.0:1789683417.710421:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683417.710434:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789683417.710439:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850165632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683417.710441:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850165888:0@lo:400:kworker.0 00000100:00100000:0.0:1789683417.710461:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683417.710468:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850165632:12345-0@lo:400:kworker.0 Request processed in 30us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683417.710474:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789683417.710482:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850164480:0@lo:400:kworker.0 00000100:00100000:1.0:1789683417.710484:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789683417.710490:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850165760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683417.710494:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850164992:0@lo:400:kworker.0 00010000:00080000:0.0:1789683417.710507:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f88c75180 x1876618850165504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683417.710513:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850165760:12345-0@lo:400:kworker.0 Request processed in 25us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683417.710519:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789683417.710528:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789683417.710530:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850165504:0@lo:400:kworker.0 00000100:00100000:1.0:1789683417.710532:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850164864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683417.710559:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850164864:12345-0@lo:400:kworker.0 Request processed in 27us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683417.710560:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850165632:0@lo:400:kworker.0 00000100:00100000:1.0:1789683417.710565:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789683417.710589:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850164864:0@lo:400:kworker.0 00010000:00080000:0.0:1789683417.710589:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f88c75c00 x1876618850165248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683417.710598:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850165248:0@lo:400:kworker.0 00000100:00080000:1.0:1789683417.710606:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789683417.710607:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f88c74a80 x1876618850165760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789683417.710608:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789683417.710630:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850165760:0@lo:400:kworker.0 00000100:00100000:1.0:1789683417.710642:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850165376 00000100:00100000:1.0:1789683417.710651:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850165376 00000100:00100000:0.0:1789683417.710662:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850165888 00000100:00100000:0.0:1789683417.710665:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850165888 00000100:00100000:1.0:1789683417.710682:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789683417.710688:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850165376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683417.710708:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850165120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683417.711290:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850165120:12345-0@lo:400:kworker.0 Request processed in 1367us (14908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683417.711299:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789683417.711457:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850165376:12345-0@lo:400:kworker.0 Request processed in 769us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683417.712297:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789683417.712317:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850165888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683417.712370:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850165888:12345-0@lo:400:kworker.0 Request processed in 61us (1908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683417.712377:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789683417.712421:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850165120:0@lo:400:kworker.0 00000100:00100000:1.0:1789683417.712449:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1789683417.712454:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789683417.712478:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f88c77100 x1876618850165376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683417.712489:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850165376:0@lo:400:kworker.0 00010000:00080000:0.0:1789683417.712500:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f88c76d80 x1876618850165888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683417.712520:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850165888:0@lo:400:kworker.0 00010000:00010000:0.0:1789683418.148774:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683419.167261:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683419.682224:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683419.682304:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683419.682335:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683419.682355:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683419.682376:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683419.682399:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683419.682427:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683419.682494:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835409664 00000100:00100000:0.0:1789683419.682508:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835409664 00000100:00100000:0.0:1789683419.682574:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835409920 00000100:00100000:0.0:1789683419.682587:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835409920 00000100:00100000:0.0:1789683419.682604:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835409536 00000100:00100000:0.0:1789683419.682607:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835409536 00000100:00100000:0.0:1789683419.682619:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835409792 00000100:00100000:0.0:1789683419.682621:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835409792 00000100:00100000:0.0:1789683419.682639:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 145 00000100:00100000:0.0:1789683419.682648:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835409664:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683419.682738:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835409664:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 90us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683419.682746:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 145 00000100:00100000:0.0:1789683419.682769:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 146 00000100:00100000:0.0:1789683419.682775:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835409920:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683419.682838:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835409920:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 63us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683419.682996:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835409408 00000100:00100000:1.0:1789683419.683001:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835409408 00000100:00100000:1.0:1789683419.683057:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 309 00000100:00100000:1.0:1789683419.683064:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:2403:x1876618835409408:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683419.683096:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:2403:x1876618835409408:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 33us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683419.683103:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 309 00000100:00100000:0.0:1789683419.683217:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 146 00000100:00100000:2.0:1789683419.684866:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835410176 00000100:00100000:2.0:1789683419.684884:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835410176 00000100:00100000:2.0:1789683419.684937:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835410048 00000100:00100000:2.0:1789683419.684940:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835410048 00000100:00100000:2.0:1789683419.684971:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:2.0:1789683419.684981:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835410176:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683419.685061:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835410176:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 82us (2703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683419.685069:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:2.0:1789683419.685085:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:2.0:1789683419.685093:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835410048:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683419.685115:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835410048:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 24us (2689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683419.685120:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:1.0:1789683419.686360:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 147 00000100:00100000:1.0:1789683419.686379:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+6:2403:x1876618835409536:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683419.686428:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+6:2403:x1876618835409536:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 58us (4051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683419.686435:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 147 00000100:00100000:1.0:1789683419.686462:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 148 00000100:00100000:1.0:1789683419.686468:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835409792:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683419.686490:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835409792:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 22us (4091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683419.686496:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 148 00000100:00080000:0.0:1789683419.688519:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683419.688527:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683419.688530:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683419.688533:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789683419.743313:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850166144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683419.743428:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683419.756255:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850166144 00000100:00100000:2.0:1789683419.756275:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850166144 00000100:00100000:3.0:1789683419.756557:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789683419.756570:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850166144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789683419.756626:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789683419.758671:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850166144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2096us (15235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683419.758684:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789683419.758830:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850166144:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789683420.195724:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683420.256930:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850166272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683420.257014:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683420.257958:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850166272 00000100:00100000:2.0:1789683420.257969:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850166272 00000100:00100000:2.0:1789683420.258035:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789683420.258043:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850166272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789683420.258180:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683420.258240:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850166272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 198us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683420.258248:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1789683420.258298:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83749880 x1876618850166272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683420.258316:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850166272:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789683420.258587:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683420.768275:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683420.768298:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850166400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683420.768375:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683420.768436:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850166400 00000100:00100000:1.0:1789683420.768445:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850166400 00000100:00100000:1.0:1789683420.768510:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789683420.768520:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850166400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683420.768543:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683420.768596:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850166400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683420.768603:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1789683420.768624:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789683420.768653:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc070ea00 x1876618850166400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683420.768688:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850166400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683420.776322:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683420.776350:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850166528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789683420.776439:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683420.776620:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850166528 00000100:00100000:1.0:1789683420.776630:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850166528 00000100:00100000:1.0:1789683420.776736:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789683420.776746:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850166528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683420.776808:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789683420.776862:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850166528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683420.776869:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789683420.776915:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850166528:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789683421.218369:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683422.241749:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683422.304149:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683422.304174:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850166656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683422.304250:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683422.304458:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850166656 00000100:00100000:2.0:1789683422.304466:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850166656 00000100:00100000:2.0:1789683422.304545:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789683422.304555:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbe545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850166656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789683422.304588:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683422.304650:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbe545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850166656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683422.304657:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1789683422.304984:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789683422.305194:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e8374b480 x1876618850166656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683422.305213:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850166656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789683422.815383:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850167168:0@lo:400:kworker.0 00000100:00100000:0.0:1789683422.815473:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683422.815534:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850167680:0@lo:400:kworker.0 00000100:00100000:0.0:1789683422.815562:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683422.815581:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850168192:0@lo:400:kworker.0 00000100:00100000:0.0:1789683422.815602:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683422.815640:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789683422.815646:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850166784:0@lo:400:kworker.0 00000100:00100000:0.0:1789683422.815675:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683422.815693:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850167296:0@lo:400:kworker.0 00000100:00100000:0.0:1789683422.815711:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683422.815732:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850167808:0@lo:400:kworker.0 00000100:00100000:0.0:1789683422.815749:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683422.815771:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850167040:0@lo:400:kworker.0 00000100:00100000:2.0:1789683422.816153:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850167680 00000100:00100000:2.0:1789683422.816164:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850167680 00000100:00100000:2.0:1789683422.816233:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850168192 00000100:00100000:2.0:1789683422.816237:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850168192 00000100:00100000:2.0:1789683422.816253:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850167808 00000100:00100000:2.0:1789683422.816255:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850167808 00000100:00100000:2.0:1789683422.816272:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789683422.816280:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850167680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683422.816361:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850167680:12345-0@lo:400:kworker.0 Request processed in 81us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683422.816384:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789683422.816402:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789683422.816408:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850168192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683422.816440:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850168192:12345-0@lo:400:kworker.0 Request processed in 33us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683422.816446:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789683422.816457:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789683422.816463:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850167808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683422.816491:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850167808:12345-0@lo:400:kworker.0 Request processed in 28us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683422.816497:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789683422.816517:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850166784 00000100:00100000:2.0:1789683422.816531:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850166784 00000100:00100000:2.0:1789683422.816559:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789683422.816566:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3649:x1876618850166784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683422.816597:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3649:x1876618850166784:12345-0@lo:400:kworker.0 Request processed in 31us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683422.816603:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789683422.816652:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850166784:0@lo:400:kworker.0 00010000:00080000:2.0:1789683422.816669:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc14aea00 x1876618850167808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683422.816681:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850167808:0@lo:400:kworker.0 00010000:00080000:2.0:1789683422.816693:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc14ad180 x1876618850167680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683422.816716:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850167680:0@lo:400:kworker.0 00010000:00080000:2.0:1789683422.816729:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc14adf80 x1876618850168192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683422.816738:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850168192:0@lo:400:kworker.0 00000100:00100000:1.0:1789683422.817419:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850166912:0@lo:400:kworker.0 00000100:00100000:1.0:1789683422.817461:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683422.817512:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1876618850167424:0@lo:400:kworker.0 00000100:00100000:1.0:1789683422.817548:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683422.817569:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850167936:0@lo:400:kworker.0 00000100:00100000:1.0:1789683422.817592:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683422.817628:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850167168 00000100:00100000:1.0:1789683422.817634:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850167168 00000100:00100000:1.0:1789683422.817662:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850166912 00000100:00100000:1.0:1789683422.817664:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850166912 00000100:00100000:1.0:1789683422.817675:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850167424 00000100:00100000:1.0:1789683422.817677:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850167424 00000100:00100000:1.0:1789683422.817691:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850167936 00000100:00100000:1.0:1789683422.817694:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850167936 00000100:00100000:1.0:1789683422.817711:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789683422.817718:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850167168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683422.817766:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850167168:12345-0@lo:400:kworker.0 Request processed in 49us (2294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683422.817773:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789683422.817815:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789683422.817821:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850166912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683422.817957:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683422.818075:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850167552:0@lo:400:kworker.0 00000100:00100000:0.0:1789683422.818102:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683422.818115:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850168064:0@lo:400:kworker.0 00000100:00100000:0.0:1789683422.818134:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683422.819105:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850166912:12345-0@lo:400:kworker.0 Request processed in 1279us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683422.819115:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789683422.819138:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850167552 00000100:00100000:1.0:1789683422.819144:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850167552 00000100:00100000:1.0:1789683422.819168:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850168064 00000100:00100000:1.0:1789683422.819171:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850168064 00000100:00100000:1.0:1789683422.819185:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789683422.819192:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876618850167424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683422.819250:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876618850167424:12345-0@lo:400:kworker.0 Request processed in 58us (1702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683422.819257:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789683422.819270:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789683422.819277:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850167936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683422.819307:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850167936:12345-0@lo:400:kworker.0 Request processed in 31us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683422.819313:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789683422.819326:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789683422.819332:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850167552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683422.819370:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850167552:12345-0@lo:400:kworker.0 Request processed in 38us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683422.819375:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789683422.819387:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789683422.819393:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876618850168064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683422.819420:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876618850168064:12345-0@lo:400:kworker.0 Request processed in 28us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683422.819426:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789683422.819486:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850166912:0@lo:400:kworker.0 00000100:00100000:1.0:1789683422.819497:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1876618850167424:0@lo:400:kworker.0 00000100:00100000:1.0:1789683422.819507:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850167936:0@lo:400:kworker.0 00000100:00100000:1.0:1789683422.819545:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850167296 00000100:00100000:1.0:1789683422.819549:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850167296 00000100:00100000:1.0:1789683422.819576:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850167040 00000100:00100000:1.0:1789683422.819586:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850167040 00000100:00100000:1.0:1789683422.819603:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789683422.819609:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850167296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683422.819645:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850167296:12345-0@lo:400:kworker.0 Request processed in 36us (3932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683422.819651:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789683422.819664:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789683422.819670:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850167040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683422.819697:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850167040:12345-0@lo:400:kworker.0 Request processed in 28us (2714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683422.819702:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789683422.819731:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850167040:0@lo:400:kworker.0 00010000:00080000:1.0:1789683422.819744:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc14af100 x1876618850167552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683422.819755:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850167552:0@lo:400:kworker.0 00010000:00080000:1.0:1789683422.819765:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc14ad500 x1876618850168064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683422.819773:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850168064:0@lo:400:kworker.0 00000100:00100000:1.0:1789683422.819838:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850167296:0@lo:400:kworker.0 00000100:00100000:1.0:1789683422.821203:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850167168:0@lo:400:kworker.0 00000100:00080000:3.0:1789683422.821482:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789683422.821488:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683422.821491:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789683422.821493:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683422.826297:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683422.834100:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850168320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683422.834171:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683422.834274:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850168320 00000100:00100000:2.0:1789683422.834283:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850168320 00000100:00100000:2.0:1789683422.834333:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789683422.834341:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850168320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683422.834363:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683422.834404:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850168320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683422.834411:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1789683422.834981:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e8374b480 x1876618850168320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683422.835104:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850168320:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789683423.263024:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789683424.094030:0:12509:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789683424.094239:0:12509:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789683424.288937:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683424.818943:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683424.819359:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683424.819392:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683424.819416:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683424.819436:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683424.819456:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683424.819481:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683424.819542:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835410432 00000100:00100000:2.0:1789683424.819552:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835410432 00000100:00100000:2.0:1789683424.819619:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835410688 00000100:00100000:2.0:1789683424.819622:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835410688 00000100:00100000:2.0:1789683424.819637:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835410560 00000100:00100000:2.0:1789683424.819639:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835410560 00000100:00100000:2.0:1789683424.819669:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835410816 00000100:00100000:2.0:1789683424.819672:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835410816 00000100:00100000:2.0:1789683424.819688:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 155 00000100:00100000:2.0:1789683424.819698:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8374bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+6:2403:x1876618835410432:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683424.819938:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835410304 00000100:00100000:0.0:1789683424.819943:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835410304 00000100:00100000:0.0:1789683424.819986:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 311 00000100:00100000:0.0:1789683424.819994:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:2402:x1876618835410304:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683424.820163:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 156 00000100:00100000:1.0:1789683424.820175:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8374b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835410688:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683424.820253:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8374bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+6:2403:x1876618835410432:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 555us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683424.820261:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 155 00000100:00100000:2.0:1789683424.820282:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 157 00000100:00100000:2.0:1789683424.820290:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835410560:12345-192.168.201.50@tcp:400:kworker.0 00000100:00080000:3.0:1789683424.821128:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789683424.821135:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683424.824475:0:6522:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789683424.824505:0:6522:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1789683424.824525:0:6523:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789683424.824543:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 158 00000100:00100000:3.0:1789683424.824559:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835410816:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683424.824700:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:2402:x1876618835410304:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 4703us (5764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683424.824710:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 311 00000100:00100000:1.0:1789683424.828912:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8374b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835410688:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 8727us (9505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683424.828930:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 156 00000100:00100000:0.0:1789683424.830206:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835410944 00000100:00100000:0.0:1789683424.830219:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835410944 00000100:00100000:0.0:1789683424.830277:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835411072 00000100:00100000:0.0:1789683424.830281:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835411072 00000100:00100000:0.0:1789683424.830307:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:0.0:1789683424.830316:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8374a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835410944:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683424.830414:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8374a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835410944:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 98us (10996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683424.830421:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:0.0:1789683424.830436:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:0.0:1789683424.830453:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835411072:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683424.830500:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835411072:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 49us (11018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683424.830518:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:2.0:1789683424.838122:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835410560:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 17820us (18672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683424.838139:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 157 00000100:00100000:3.0:1789683424.841797:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835410816:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 17206us (22302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683424.841814:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 158 00000100:00080000:3.0:1789683424.842267:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789683424.842273:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683424.863137:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850168448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683424.863214:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683424.863294:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850168448 00000100:00100000:0.0:1789683424.863302:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850168448 00000100:00100000:0.0:1789683424.863349:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789683424.863358:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850168448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789683424.863392:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789683424.863468:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850168448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683424.863475:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789683424.863531:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850168448:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789683425.317883:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683425.377535:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683425.377560:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850168576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683425.377630:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683425.377702:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850168576 00000100:00100000:0.0:1789683425.377710:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850168576 00000100:00100000:0.0:1789683425.377761:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789683425.377769:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850168576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789683425.377816:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683425.377859:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850168576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683425.377865:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1789683425.377887:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789683425.377914:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e81d40e00 x1876618850168576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683425.378030:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850168576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683425.887055:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683425.887345:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683425.887375:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850168832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683425.887460:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683425.887543:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850168832 00000100:00100000:2.0:1789683425.887553:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850168832 00000100:00100000:2.0:1789683425.887617:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789683425.887627:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8374b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850168832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789683425.887652:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683425.887704:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8374b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850168832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683425.887711:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1789683425.887733:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789683425.887768:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e81d40e00 x1876618850168832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683425.887839:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850168832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683425.889042:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850168704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683425.889098:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683425.892326:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850168704 00000100:00100000:2.0:1789683425.892341:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850168704 00000100:00100000:2.0:1789683425.892413:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789683425.892423:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850168704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683425.892476:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789683425.892660:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850168704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 237us (3561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683425.892667:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789683425.894895:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850168704:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789683426.344269:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789683426.444132:0:12607:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789683426.444282:0:12607:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789683427.360716:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683427.426949:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850168960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683427.427025:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683427.427107:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850168960 00000100:00100000:1.0:1789683427.427116:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850168960 00000100:00100000:1.0:1789683427.427176:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789683427.427186:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850168960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789683427.427218:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683427.427263:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850168960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683427.427271:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1789683427.427293:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789683427.427323:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc070e680 x1876618850168960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683427.427341:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850168960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683427.935130:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850169344:0@lo:400:kworker.0 00000100:00100000:1.0:1789683427.935224:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683427.935285:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850169856:0@lo:400:kworker.0 00000100:00100000:1.0:1789683427.935310:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683427.935327:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850170368:0@lo:400:kworker.0 00000100:00100000:1.0:1789683427.935348:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683427.935371:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789683427.935377:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850169216:0@lo:400:kworker.0 00000100:00100000:1.0:1789683427.935400:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683427.935415:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850169728:0@lo:400:kworker.0 00000100:00100000:1.0:1789683427.935449:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683427.935468:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850170240:0@lo:400:kworker.0 00000100:00100000:1.0:1789683427.935488:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683427.935519:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850169344 00000100:00100000:1.0:1789683427.935527:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850169344 00000100:00100000:1.0:1789683427.935576:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789683427.935586:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850169344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683427.935641:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850169344:12345-0@lo:400:kworker.0 Request processed in 56us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683427.935648:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789683427.935672:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850169856 00000100:00100000:1.0:1789683427.935675:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850169856 00000100:00100000:1.0:1789683427.935701:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850170368 00000100:00100000:1.0:1789683427.935704:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850170368 00000100:00100000:1.0:1789683427.935715:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850169216 00000100:00100000:1.0:1789683427.935717:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850169216 00000100:00100000:1.0:1789683427.935726:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850169728 00000100:00100000:1.0:1789683427.935728:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850169728 00000100:00100000:1.0:1789683427.935749:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850170240 00000100:00100000:1.0:1789683427.935752:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850170240 00000100:00100000:1.0:1789683427.935766:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789683427.935773:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850169856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683427.935845:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850169856:12345-0@lo:400:kworker.0 Request processed in 72us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683427.935851:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789683427.935863:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789683427.935869:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850170368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683427.935891:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850170368:12345-0@lo:400:kworker.0 Request processed in 22us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683427.935896:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789683427.935905:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789683427.935910:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850169216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683427.935931:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850169216:12345-0@lo:400:kworker.0 Request processed in 21us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683427.935936:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789683427.935945:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789683427.935950:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850169728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683427.935971:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850169728:12345-0@lo:400:kworker.0 Request processed in 21us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683427.935976:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789683427.935985:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789683427.935990:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850170240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683427.936014:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850170240:12345-0@lo:400:kworker.0 Request processed in 25us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683427.936025:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:1.0:1789683427.936044:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683427.936048:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683427.936081:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850169216:0@lo:400:kworker.0 00000100:00100000:1.0:1789683427.936090:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850169728:0@lo:400:kworker.0 00000100:00100000:1.0:1789683427.936097:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850170240:0@lo:400:kworker.0 00000100:00100000:1.0:1789683427.936105:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850169344:0@lo:400:kworker.0 00010000:00080000:1.0:1789683427.936116:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83cadf80 x1876618850169856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683427.936125:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850169856:0@lo:400:kworker.0 00010000:00080000:1.0:1789683427.936135:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83cae680 x1876618850170368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683427.936143:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850170368:0@lo:400:kworker.0 00000100:00100000:2.0:1789683427.936261:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850169088:0@lo:400:kworker.0 00000100:00100000:2.0:1789683427.936295:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683427.936332:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850169600:0@lo:400:kworker.0 00000100:00100000:2.0:1789683427.936357:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683427.936378:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850170112:0@lo:400:kworker.0 00000100:00100000:2.0:1789683427.936401:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683427.936423:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789683427.936442:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850169472:0@lo:400:kworker.0 00000100:00100000:2.0:1789683427.936466:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683427.936484:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850169984:0@lo:400:kworker.0 00000100:00100000:2.0:1789683427.936503:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683427.936519:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850170496:0@lo:400:kworker.0 00000100:00100000:2.0:1789683427.936537:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683427.936563:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850169472 00000100:00100000:2.0:1789683427.936575:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850169472 00000100:00100000:2.0:1789683427.936606:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789683427.936613:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850169472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683427.936649:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850169472:12345-0@lo:400:kworker.0 Request processed in 37us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683427.936655:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789683427.936676:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850169600 00000100:00100000:2.0:1789683427.936680:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850169600 00000100:00100000:2.0:1789683427.936701:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789683427.936707:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850169600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683427.936737:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850169600:12345-0@lo:400:kworker.0 Request processed in 31us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683427.936743:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789683427.936811:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850170112 00000100:00100000:2.0:1789683427.936816:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850170112 00000100:00100000:2.0:1789683427.936845:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850169984 00000100:00100000:2.0:1789683427.936848:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850169984 00000100:00100000:2.0:1789683427.936858:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850170496 00000100:00100000:2.0:1789683427.936860:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850170496 00000100:00100000:2.0:1789683427.936875:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789683427.936880:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850170112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683427.936911:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850170112:12345-0@lo:400:kworker.0 Request processed in 32us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683427.936917:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789683427.936927:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789683427.936933:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850169984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683427.936956:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850169984:12345-0@lo:400:kworker.0 Request processed in 24us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683427.936970:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789683427.936981:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789683427.936987:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850170496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683427.937018:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850170496:12345-0@lo:400:kworker.0 Request processed in 32us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683427.937023:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1789683427.937049:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683427.937052:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683427.937063:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850170624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683427.937087:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683427.937114:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850169472:0@lo:400:kworker.0 00010000:00080000:2.0:1789683427.937125:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83cad500 x1876618850169984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683427.937134:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850169984:0@lo:400:kworker.0 00010000:00080000:2.0:1789683427.937142:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83cadc00 x1876618850170496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683427.937149:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850170496:0@lo:400:kworker.0 00000100:00100000:2.0:1789683427.937157:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850169600:0@lo:400:kworker.0 00010000:00080000:2.0:1789683427.937165:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83caf800 x1876618850170112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683427.937173:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850170112:0@lo:400:kworker.0 00000100:00100000:2.0:1789683427.937201:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850170624 00000100:00100000:2.0:1789683427.937210:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850170624 00000100:00100000:2.0:1789683427.937233:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789683427.937238:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850170624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683427.937251:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683427.937286:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850170624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683427.937291:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:2.0:1789683427.937317:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc14adf80 x1876618850170624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683427.937331:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850170624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683427.941523:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850169088 00000100:00100000:1.0:1789683427.941542:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850169088 00000100:00100000:1.0:1789683427.941612:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789683427.941623:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850169088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683427.941853:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850169088:12345-0@lo:400:kworker.0 Request processed in 231us (5555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683427.941860:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789683427.947985:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850169088:0@lo:400:kworker.0 00010000:00010000:0.0:1789683428.387737:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789683429.256663:0:12705:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789683429.261020:0:12705:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789683429.408568:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683429.912287:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683429.912328:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683429.912369:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683429.912428:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683429.912449:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683429.912468:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683429.912490:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683429.912573:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835411200 00000100:00100000:1.0:1789683429.912584:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835411200 00000100:00100000:1.0:1789683429.912642:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 313 00000100:00100000:1.0:1789683429.912668:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:2402:x1876618835411200:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683429.912756:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:2402:x1876618835411200:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 91us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683429.912765:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 313 00000100:00100000:3.0:1789683429.913273:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835411328 00000100:00100000:3.0:1789683429.913280:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835411328 00000100:00100000:3.0:1789683429.913331:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835411584 00000100:00100000:3.0:1789683429.913335:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835411584 00000100:00100000:3.0:1789683429.913349:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835411456 00000100:00100000:3.0:1789683429.913351:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835411456 00000100:00100000:3.0:1789683429.913362:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835411712 00000100:00100000:3.0:1789683429.913364:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835411712 00000100:00100000:3.0:1789683429.913378:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 165 00000100:00100000:3.0:1789683429.913385:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835411328:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683429.913438:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835411328:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 52us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683429.913445:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 165 00000100:00100000:3.0:1789683429.913458:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 166 00000100:00100000:3.0:1789683429.913465:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835411584:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683429.913488:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835411584:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 23us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683429.913493:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 166 00000100:00100000:3.0:1789683429.913504:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 167 00000100:00100000:3.0:1789683429.913510:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835411456:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683429.913533:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835411456:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 23us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683429.913539:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 167 00000100:00100000:3.0:1789683429.913550:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 168 00000100:00100000:3.0:1789683429.913556:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835411712:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683429.913591:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835411712:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 35us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683429.913598:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 168 00000100:00100000:2.0:1789683429.914050:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835411840 00000100:00100000:2.0:1789683429.914058:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835411840 00000100:00100000:2.0:1789683429.914095:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835411968 00000100:00100000:2.0:1789683429.914098:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835411968 00000100:00100000:2.0:1789683429.914119:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:2.0:1789683429.914125:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13ee1651-c170-427a-b389-1f9d341ed790+5:2401:x1876618835411840:12345-192.168.201.50@tcp:9:kworker.0 00000020:00000080:2.0:1789683429.914145:0:8439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889732 00000100:00080000:2.0:1789683429.914154:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9f0e83445800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789683429.914194:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789683429.914311:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13ee1651-c170-427a-b389-1f9d341ed790+2:2401:x1876618835411840:12345-192.168.201.50@tcp:9:kworker.0 Request processed in 185us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683429.914317:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:2.0:1789683429.914330:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:2.0:1789683429.914336:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13ee1651-c170-427a-b389-1f9d341ed790+5:2401:x1876618835411968:12345-192.168.201.50@tcp:9:kworker.0 00000020:00000080:2.0:1789683429.914347:0:8439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889739 00000100:00080000:2.0:1789683429.914352:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9f0e83447800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789683429.914383:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789683429.914467:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13ee1651-c170-427a-b389-1f9d341ed790+2:2401:x1876618835411968:12345-192.168.201.50@tcp:9:kworker.0 Request processed in 131us (1975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683429.914474:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00010000:00010000:2.0:1789683429.914609:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789683429.915220:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789683429.915226:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683429.915229:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789683429.915232:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789683429.915240:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683429.983991:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850170752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683429.984078:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683429.985003:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850170752 00000100:00100000:0.0:1789683429.985018:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850170752 00000100:00100000:0.0:1789683429.985089:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789683429.985100:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850170752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789683429.985141:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789683429.985206:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850170752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683429.985212:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789683429.985331:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850170752:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789683430.432993:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683430.496097:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850170880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683430.496173:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683430.496287:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850170880 00000100:00100000:0.0:1789683430.496297:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850170880 00000100:00100000:0.0:1789683430.496373:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789683430.496394:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850170880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789683430.496426:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683430.496475:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850170880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683430.496501:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1789683430.496773:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789683430.496909:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e81d41c00 x1876618850170880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683430.496929:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850170880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683431.007072:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683431.007095:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850171008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683431.007162:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683431.007221:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850171008 00000100:00100000:0.0:1789683431.007228:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850171008 00000100:00100000:0.0:1789683431.007291:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789683431.007302:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850171008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683431.007324:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789683431.007349:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683431.007367:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850171008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683431.007374:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1789683431.007405:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e81d41c00 x1876618850171008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683431.007424:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850171008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683431.013250:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850171136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789683431.013327:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683431.013437:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850171136 00000100:00100000:3.0:1789683431.013446:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850171136 00000100:00100000:3.0:1789683431.013498:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789683431.013508:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850171136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789683431.013545:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789683431.013592:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850171136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683431.013598:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789683431.013901:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850171136:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789683431.455218:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789683432.174159:0:12802:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789683432.174468:0:12802:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789683432.478970:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683432.542941:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683432.542964:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850171264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683432.543030:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683432.543195:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850171264 00000100:00100000:0.0:1789683432.543204:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850171264 00000100:00100000:0.0:1789683432.543278:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789683432.543288:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850171264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789683432.543318:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683432.543381:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850171264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683432.543388:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1789683432.543454:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789683432.543611:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83caf100 x1876618850171264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683432.543646:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850171264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789683433.055963:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850171392:0@lo:400:kworker.0 00000100:00100000:0.0:1789683433.056044:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683433.056234:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850171392 00000100:00100000:2.0:1789683433.056244:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850171392 00000100:00100000:2.0:1789683433.056290:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789683433.056299:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3650:x1876618850171392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.064953:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850171776:0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.065032:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683433.065084:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850171520:0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.065109:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683433.065129:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683433.065136:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850171648:0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.065162:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683433.065305:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850171776 00000100:00100000:1.0:1789683433.065313:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850171776 00000100:00100000:1.0:1789683433.065372:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850171520 00000100:00100000:1.0:1789683433.065376:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850171520 00000100:00100000:1.0:1789683433.065397:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789683433.065404:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850171776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.065455:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850171776:12345-0@lo:400:kworker.0 Request processed in 52us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683433.065462:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789683433.065480:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789683433.065485:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850171520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.065514:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850171520:12345-0@lo:400:kworker.0 Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683433.065519:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789683433.065539:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850171648 00000100:00100000:1.0:1789683433.065542:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850171648 00000100:00100000:1.0:1789683433.065567:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789683433.065586:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850171648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.065621:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850171648:12345-0@lo:400:kworker.0 Request processed in 36us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683433.065758:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3650:x1876618850171392:12345-0@lo:400:kworker.0 Request processed in 9458us (9712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683433.065768:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789683433.066927:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789683433.066996:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850171776:0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.067016:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683433.067025:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850171904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683433.067072:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683433.067124:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850171648:0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.067137:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850171520:0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.067190:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850172032:0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.067215:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683433.067266:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850172160:0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.067292:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683433.067324:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850172160 00000100:00100000:1.0:1789683433.067329:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850172160 00000100:00100000:1.0:1789683433.067383:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789683433.067392:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850172160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.067437:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850172160:12345-0@lo:400:kworker.0 Request processed in 48us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683433.067444:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:1.0:1789683433.067461:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683433.067481:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850172160:0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.067512:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850172288:0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.067551:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683433.067578:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850172288 00000100:00100000:1.0:1789683433.067582:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850172288 00000100:00100000:1.0:1789683433.067610:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789683433.067616:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850172288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.068321:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850172288:12345-0@lo:400:kworker.0 Request processed in 702us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683433.068329:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:1.0:1789683433.068359:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683433.068402:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850172544:0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.068429:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683433.068464:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850172544 00000100:00100000:1.0:1789683433.068469:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850172544 00000100:00100000:1.0:1789683433.068505:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789683433.068512:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850172544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.068550:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850172544:12345-0@lo:400:kworker.0 Request processed in 39us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683433.068556:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1789683433.068570:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789683433.068591:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7998700 x1876618850172544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683433.068603:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850172544:0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.068647:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850172672:0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.068674:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683433.068703:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850172672 00000100:00100000:1.0:1789683433.068707:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850172672 00000100:00100000:1.0:1789683433.068745:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789683433.068750:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850172672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683433.068922:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850171904 00000100:00100000:2.0:1789683433.068928:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850171904 00000100:00100000:2.0:1789683433.068962:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789683433.068969:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850171904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683433.068983:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683433.069017:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850171904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (1945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683433.069031:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789683433.069145:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850172672:12345-0@lo:400:kworker.0 Request processed in 34us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683433.069151:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:1.0:1789683433.069166:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789683433.069169:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683433.069188:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850172672:0@lo:400:kworker.0 00000100:00100000:0.0:1789683433.069356:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850171392:0@lo:400:kworker.0 00000100:00100000:0.0:1789683433.069382:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850172032 00000100:00100000:0.0:1789683433.069387:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850172032 00000100:00100000:0.0:1789683433.069431:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789683433.069437:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850172032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683433.069489:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850172032:12345-0@lo:400:kworker.0 Request processed in 52us (2274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683433.069495:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789683433.071045:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850172032:0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.072066:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850172416:0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.072134:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683433.072178:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850172928:0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.072203:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683433.072228:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683433.072236:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850172800:0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.072261:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683433.072287:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850172800 00000100:00100000:1.0:1789683433.072294:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850172800 00000100:00100000:1.0:1789683433.072356:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789683433.072365:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850172800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683433.072412:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850172800:12345-0@lo:400:kworker.0 Request processed in 49us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683433.072419:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:1.0:1789683433.072440:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789683433.072465:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7998700 x1876618850172800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683433.072478:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850172800:0@lo:400:kworker.0 00000100:00100000:2.0:1789683433.072549:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850172416 00000100:00100000:2.0:1789683433.072554:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850172416 00000100:00100000:2.0:1789683433.072593:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850172928 00000100:00100000:2.0:1789683433.072596:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850172928 00000100:00100000:2.0:1789683433.072612:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789683433.072619:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850172416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683433.072667:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850172416:12345-0@lo:400:kworker.0 Request processed in 49us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683433.072673:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789683433.072686:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789683433.072692:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850172928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683433.072719:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850172928:12345-0@lo:400:kworker.0 Request processed in 28us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683433.072725:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1789683433.073116:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789683433.073143:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7999c00 x1876618850172416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683433.073154:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850172416:0@lo:400:kworker.0 00010000:00080000:1.0:1789683433.073164:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7998e00 x1876618850172928/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683433.073171:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850172928:0@lo:400:kworker.0 00010000:00080000:3.0:1789683433.079408:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83cad500 x1876618850172288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683433.079429:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850172288:0@lo:400:kworker.0 00010000:00080000:3.0:1789683433.079490:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc14aea00 x1876618850171904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683433.079509:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850171904:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789683433.503350:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789683434.226512:0:12899:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789683434.230310:0:12899:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789683434.527202:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683435.039297:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683435.039345:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683435.039386:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683435.039407:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683435.039430:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683435.039455:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835412096 00000100:00100000:0.0:1789683435.039466:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835412096 00000100:00100000:0.0:1789683435.039515:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 315 00000100:00100000:0.0:1789683435.039524:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:2404:x1876618835412096:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683435.039593:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:2404:x1876618835412096:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 69us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683435.039600:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 315 00000100:00100000:2.0:1789683435.039671:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835412224 00000100:00100000:2.0:1789683435.039677:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835412224 00000100:00100000:2.0:1789683435.039723:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835412480 00000100:00100000:2.0:1789683435.039726:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835412480 00000100:00100000:2.0:1789683435.039739:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835412352 00000100:00100000:2.0:1789683435.039741:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835412352 00000100:00100000:2.0:1789683435.039752:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835412608 00000100:00100000:2.0:1789683435.039755:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835412608 00000100:00100000:2.0:1789683435.039771:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 175 00000100:00100000:2.0:1789683435.039802:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+6:2404:x1876618835412224:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683435.039840:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+6:2404:x1876618835412224:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 62us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683435.039854:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 175 00000100:00100000:2.0:1789683435.039870:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 176 00000100:00100000:2.0:1789683435.039876:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2404:x1876618835412480:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683435.039903:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2404:x1876618835412480:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683435.039909:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 176 00000100:00100000:2.0:1789683435.039922:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 177 00000100:00100000:2.0:1789683435.039927:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835412352:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683435.039947:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835412352:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 21us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683435.039952:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 177 00000100:00100000:2.0:1789683435.039963:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 178 00000100:00100000:2.0:1789683435.039968:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2404:x1876618835412608:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683435.039987:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2404:x1876618835412608:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 19us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683435.039992:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 178 00000100:00080000:0.0:1789683435.040427:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683435.040431:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683435.108485:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683435.108509:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850173056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683435.108584:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683435.108649:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850173056 00000100:00100000:0.0:1789683435.108657:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850173056 00000100:00100000:0.0:1789683435.108704:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789683435.108714:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850173056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789683435.108762:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789683435.108838:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850173056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683435.108845:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789683435.108893:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850173056:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789683435.551331:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683435.617965:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850173184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683435.618056:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683435.618135:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850173184 00000100:00100000:1.0:1789683435.618142:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850173184 00000100:00100000:1.0:1789683435.618198:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789683435.618208:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850173184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789683435.618239:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683435.618285:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850173184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683435.618301:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1789683435.618325:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789683435.618355:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e82fe4e00 x1876618850173184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683435.618376:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850173184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683436.127098:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850173312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683436.127192:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683436.127381:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850173312 00000100:00100000:3.0:1789683436.127389:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850173312 00000100:00100000:3.0:1789683436.127441:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789683436.127452:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850173312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789683436.127487:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789683436.127557:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850173312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683436.127565:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789683436.127678:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850173312:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1789683436.133091:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 13ee1651-c170-427a-b389-1f9d341ed790 00000020:00000080:1.0:1789683436.133103:0:8433:0:(genops.c:885:class_export_put()) final put ffff9f0e83443800/13ee1651-c170-427a-b389-1f9d341ed790 00000020:00000080:3.0:1789683436.138659:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83443800/13ee1651-c170-427a-b389-1f9d341ed790 for lustre-OST0000 00000020:00000080:3.0:1789683436.138717:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e83445800 for lustre-OST0000 00000100:00100000:3.0:1789683436.140097:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683436.140119:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850173440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683436.140188:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683436.142204:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850173440 00000100:00100000:0.0:1789683436.142220:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850173440 00000100:00100000:0.0:1789683436.142320:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789683436.142332:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850173440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683436.142358:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683436.142439:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850173440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (2249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683436.142445:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1789683436.142509:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83caf100 x1876618850173440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683436.142531:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850173440:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789683436.142955:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1789683436.143189:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 13ee1651-c170-427a-b389-1f9d341ed790 00000020:00000080:1.0:1789683436.143195:0:9518:0:(genops.c:885:class_export_put()) final put ffff9f0e83445000/13ee1651-c170-427a-b389-1f9d341ed790 00000020:00000080:3.0:1789683436.143267:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83445000/13ee1651-c170-427a-b389-1f9d341ed790 for lustre-OST0001 00000020:00000080:3.0:1789683436.143326:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e83447800 for lustre-OST0001 00010000:00010000:2.0:1789683436.575924:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683437.600524:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683437.663652:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683437.663679:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850173568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683437.663750:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683437.664085:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850173568 00000100:00100000:0.0:1789683437.664095:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850173568 00000100:00100000:0.0:1789683437.664173:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789683437.664183:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850173568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789683437.664227:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683437.664318:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850173568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683437.664325:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:2.0:1789683437.664537:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7998e00 x1876618850173568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683437.664556:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850173568:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789683437.664628:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683438.177978:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850173824:0@lo:400:kworker.0 00000100:00100000:1.0:1789683438.178074:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683438.178270:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850173696:0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.178315:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683438.178350:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850174080:0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.178377:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683438.178440:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850174336:0@lo:400:kworker.0 00000100:00100000:1.0:1789683438.178468:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683438.179094:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850173696 00000100:00100000:2.0:1789683438.179104:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850173696 00000100:00100000:2.0:1789683438.179190:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789683438.179202:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850173696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683438.179284:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850173696:12345-0@lo:400:kworker.0 Request processed in 85us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683438.179292:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789683438.184688:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850173824 00000100:00100000:3.0:1789683438.184724:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850173824 00000100:00100000:3.0:1789683438.184851:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850174080 00000100:00100000:3.0:1789683438.184856:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850174080 00000100:00100000:3.0:1789683438.184880:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850174336 00000100:00100000:3.0:1789683438.184883:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850174336 00000100:00100000:3.0:1789683438.184917:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789683438.184928:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850173824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.185058:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850173824:12345-0@lo:400:kworker.0 Request processed in 132us (6985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683438.185067:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789683438.185089:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789683438.185095:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850174080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.190441:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850174080:12345-0@lo:400:kworker.0 Request processed in 5328us (12045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683438.190473:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789683438.190641:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789683438.190664:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850174336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.190835:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850174336:12345-0@lo:400:kworker.0 Request processed in 183us (12365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683438.190842:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:3.0:1789683438.190882:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683438.190963:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850173952:0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.191013:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683438.191195:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850174336:0@lo:400:kworker.0 00000100:00100000:1.0:1789683438.191242:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850174848:0@lo:400:kworker.0 00000100:00100000:1.0:1789683438.191287:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683438.191313:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850174848 00000100:00100000:1.0:1789683438.191321:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850174848 00000100:00100000:1.0:1789683438.191372:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789683438.191379:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850174848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683438.191414:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850174848:12345-0@lo:400:kworker.0 Request processed in 36us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683438.191420:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:1.0:1789683438.191437:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683438.191672:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850173696:0@lo:400:kworker.0 00000100:00100000:2.0:1789683438.191685:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850174208:0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.191983:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850174464:0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.192021:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683438.192045:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850174976:0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.192067:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683438.192090:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683438.192098:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850175360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683438.192126:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683438.192604:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850174464 00000100:00100000:3.0:1789683438.192612:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850174464 00000100:00100000:3.0:1789683438.192673:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850174976 00000100:00100000:3.0:1789683438.192677:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850174976 00000100:00100000:3.0:1789683438.192699:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789683438.192708:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850174464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.193615:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850174464:12345-0@lo:400:kworker.0 Request processed in 905us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683438.193647:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789683438.193675:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789683438.193682:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850174976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.194316:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850174976:12345-0@lo:400:kworker.0 Request processed in 633us (2245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683438.194325:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789683438.194363:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850175360 00000100:00100000:3.0:1789683438.194371:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850175360 00000100:00100000:3.0:1789683438.194419:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789683438.194427:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850175360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683438.194448:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683438.194581:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683438.194634:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850174720:0@lo:400:kworker.0 00000100:00100000:2.0:1789683438.194677:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683438.194699:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850175232:0@lo:400:kworker.0 00000100:00100000:2.0:1789683438.194733:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683438.194993:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850175360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 565us (2864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683438.195000:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1789683438.195049:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f88c77b80 x1876618850175360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683438.195073:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850175360:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789683438.195087:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb79b5c00 x1876618850174464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683438.195097:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850174464:0@lo:400:kworker.0 00010000:00080000:3.0:1789683438.195109:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7244e00 x1876618850174976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683438.195117:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850174976:0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.195223:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850173952 00000100:00100000:3.0:1789683438.195230:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850173952 00000100:00100000:3.0:1789683438.195271:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850174208 00000100:00100000:3.0:1789683438.195275:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850174208 00000100:00100000:3.0:1789683438.195291:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789683438.195297:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850173952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.195344:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850173952:12345-0@lo:400:kworker.0 Request processed in 47us (4331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683438.195352:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789683438.195364:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789683438.195370:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850174208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.195402:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850174208:12345-0@lo:400:kworker.0 Request processed in 32us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683438.195408:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789683438.195437:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850173952:0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.195481:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850174080:0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.195491:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850174592:0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.195518:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683438.195542:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850175104:0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.195563:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683438.195596:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850174720 00000100:00100000:3.0:1789683438.195600:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850174720 00000100:00100000:3.0:1789683438.195625:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850175232 00000100:00100000:3.0:1789683438.195628:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850175232 00000100:00100000:3.0:1789683438.195638:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850174592 00000100:00100000:3.0:1789683438.195640:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850174592 00000100:00100000:3.0:1789683438.195665:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850175104 00000100:00100000:3.0:1789683438.195668:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850175104 00000100:00100000:3.0:1789683438.195680:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789683438.195685:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850174720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.198428:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850174720:12345-0@lo:400:kworker.0 Request processed in 2729us (3737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683438.198915:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789683438.198981:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789683438.199005:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850175232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.199141:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850175232:12345-0@lo:400:kworker.0 Request processed in 150us (4407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683438.199155:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789683438.199170:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789683438.199180:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850174592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.199235:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850174592:12345-0@lo:400:kworker.0 Request processed in 58us (3717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683438.199241:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789683438.199265:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789683438.199272:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850175104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.199302:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850175104:12345-0@lo:400:kworker.0 Request processed in 31us (3739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683438.199308:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1789683438.199367:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb79b6680 x1876618850174592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683438.199386:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850174592:0@lo:400:kworker.0 00010000:00080000:3.0:1789683438.199423:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7247b80 x1876618850175104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683438.199432:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850175104:0@lo:400:kworker.0 00000100:00100000:3.0:1789683438.199918:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850174208:0@lo:400:kworker.0 00010000:00080000:3.0:1789683438.199934:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7247800 x1876618850174720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683438.199945:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850174720:0@lo:400:kworker.0 00010000:00080000:3.0:1789683438.199956:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7246680 x1876618850175232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683438.199964:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850175232:0@lo:400:kworker.0 00000100:00100000:1.0:1789683438.200143:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850174848:0@lo:400:kworker.0 00000100:00080000:1.0:1789683438.200189:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683438.200194:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789683438.200198:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683438.200242:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850173824:0@lo:400:kworker.0 00010000:00010000:2.0:1789683438.623250:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789683439.072302:0:13045:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789683439.648631:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683440.149602:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683440.149648:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683440.149698:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683440.149723:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683440.149747:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683440.149815:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835412736 00000100:00100000:2.0:1789683440.149825:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835412736 00000100:00100000:2.0:1789683440.149879:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 317 00000100:00100000:2.0:1789683440.149890:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:2405:x1876618835412736:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683440.149959:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:2405:x1876618835412736:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 70us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683440.149979:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 317 00000100:00100000:0.0:1789683440.150279:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835412864 00000100:00100000:0.0:1789683440.150284:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835412864 00000100:00100000:0.0:1789683440.150339:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835413120 00000100:00100000:0.0:1789683440.150343:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835413120 00000100:00100000:0.0:1789683440.150358:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835412992 00000100:00100000:0.0:1789683440.150360:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835412992 00000100:00100000:0.0:1789683440.150372:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835413248 00000100:00100000:0.0:1789683440.150374:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835413248 00000100:00100000:0.0:1789683440.150389:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 185 00000100:00100000:0.0:1789683440.150396:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+6:2405:x1876618835412864:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683440.150435:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+6:2405:x1876618835412864:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 39us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683440.150441:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 185 00000100:00100000:0.0:1789683440.150457:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 186 00000100:00100000:0.0:1789683440.150464:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835413120:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683440.150487:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835413120:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683440.150509:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 186 00000100:00100000:0.0:1789683440.150523:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 187 00000100:00100000:0.0:1789683440.150530:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835412992:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683440.150556:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835412992:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 26us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683440.150561:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 187 00000100:00100000:0.0:1789683440.150578:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 188 00000100:00100000:0.0:1789683440.150584:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835413248:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683440.150622:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835413248:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 38us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683440.150628:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 188 00000100:00080000:2.0:1789683440.151588:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789683440.151595:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683440.224363:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683440.224389:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850175488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683440.224460:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683440.224532:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850175488 00000100:00100000:1.0:1789683440.224541:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850175488 00000100:00100000:1.0:1789683440.224587:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789683440.224596:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850175488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683440.224629:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789683440.224677:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850175488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683440.224684:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789683440.224737:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850175488:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789683440.672934:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683440.735738:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850175616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683440.735855:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683440.736853:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850175616 00000100:00100000:0.0:1789683440.736863:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850175616 00000100:00100000:0.0:1789683440.736932:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789683440.736943:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850175616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789683440.736976:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683440.737034:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850175616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683440.737041:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1789683440.738018:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789683440.741428:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0708e00 x1876618850175616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683440.741463:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850175616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683441.250937:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850175744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683441.251015:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683441.251139:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850175744 00000100:00100000:3.0:1789683441.251148:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850175744 00000100:00100000:3.0:1789683441.251221:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789683441.251231:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850175744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683441.251253:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683441.251296:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850175744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683441.251304:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1789683441.251362:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789683441.251392:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7246680 x1876618850175744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683441.251409:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850175744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683441.252562:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683441.252576:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850175872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683441.252624:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683441.252734:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850175872 00000100:00100000:0.0:1789683441.252740:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850175872 00000100:00100000:0.0:1789683441.252800:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789683441.252810:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850175872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789683441.252849:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789683441.252899:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850175872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683441.252905:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789683441.252944:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850175872:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789683441.705843:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683442.723802:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683442.783087:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683442.783108:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850176000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683442.783187:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683442.783251:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850176000 00000100:00100000:2.0:1789683442.783259:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850176000 00000100:00100000:2.0:1789683442.783310:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789683442.783318:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850176000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789683442.783348:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683442.783392:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850176000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683442.783400:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1789683442.783422:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789683442.783449:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83c60000 x1876618850176000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683442.783467:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850176000:0@lo:13:osp-pre-1-1.0 00000020:00000080:3.0:1789683442.798542:0:13194:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0d993dc0 20000000:00000080:3.0:1789683442.798564:0:13194:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0e827b9c00 uarg=0000000000000000 20000000:01000000:3.0:1789683442.799318:0:13194:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789683442.799395:0:13194:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789683442.799402:0:13194:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789683442.800268:0:13195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1789683442.800429:0:13194:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789683442.813319:0:13194:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789683442.813352:0:13194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0f81677200/0xcf8485587b889740 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.813375:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f8454ce00/0xcf8485587b8896d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc448 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.813385:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0e837da200/0xcf8485587b8896de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8896d7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.813393:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0e837da400/0xcf8485587b8896ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8896e5 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.813400:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b8896fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8896f3 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.813408:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0e837da800/0xcf8485587b889708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889701 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.813417:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f81391a00/0xcf8485587b88971d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc487 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.813424:0:13194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0f81677200/0xcf8485587b889740 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.813468:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f81391a00/0xcf8485587b88971d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc487 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.813498:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0f81391a00/0xcf8485587b88971d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc487 expref: 12 pid: 6516 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683442.813515:0:13194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876618850176128:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789683442.813764:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0e837da800/0xcf8485587b889708 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b889701 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.813774:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0e837da800/0xcf8485587b889708 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b889701 expref: 23 pid: 6516 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683442.813890:0:13194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876618850176256:0@lo:104: 00000100:00100000:3.0:1789683442.814922:0:13194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789683442.814989:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b8896fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b8896f3 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.815003:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b8896fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b8896f3 expref: 23 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683442.815016:0:13194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876618850176384:0@lo:104: 00000100:00100000:3.0:1789683442.815047:0:13194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789683442.815071:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0e837da400/0xcf8485587b8896ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b8896e5 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.815080:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0e837da400/0xcf8485587b8896ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b8896e5 expref: 23 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683442.815088:0:13194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876618850176512:0@lo:104: 00000100:00100000:3.0:1789683442.815106:0:13194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789683442.815135:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0e837da200/0xcf8485587b8896de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b8896d7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.815144:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0e837da200/0xcf8485587b8896de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b8896d7 expref: 23 pid: 6516 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683442.815153:0:13194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876618850176640:0@lo:104: 00000100:00100000:3.0:1789683442.815185:0:13194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789683442.815207:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f8454ce00/0xcf8485587b8896d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc448 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.815217:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0f8454ce00/0xcf8485587b8896d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc448 expref: 12 pid: 6516 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683442.815227:0:13194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83762a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876618850176768:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789683442.815237:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850176256 00000100:00100000:1.0:1789683442.815244:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850176256 00000100:00100000:3.0:1789683442.815270:0:13194:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f905306c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683442.815281:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850176384 00000100:00100000:1.0:1789683442.815283:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850176384 00000100:00100000:1.0:1789683442.815301:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850176512 00000100:00100000:1.0:1789683442.815304:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850176512 00000100:00100000:1.0:1789683442.815312:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850176640 00000100:00100000:1.0:1789683442.815314:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850176640 00000100:00100000:1.0:1789683442.815337:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789683442.815346:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+6:13194:x1876618850176256:12345-0@lo:104: 00010000:00010000:1.0:1789683442.815358:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b889701 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889708 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.815410:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683442.815414:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+6:13194:x1876618850176256:12345-0@lo:104: Request processed in 71us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683442.815525:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789683442.815542:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789683442.815548:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:13194:x1876618850176384:12345-0@lo:104: 00010000:00010000:1.0:1789683442.815556:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8896f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8896fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.815601:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789683442.815605:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:13194:x1876618850176384:12345-0@lo:104: Request processed in 58us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683442.815610:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789683442.815673:0:13194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876618850176256:0@lo:104: 00000100:00100000:3.0:1789683442.815684:0:13194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876618850176384:0@lo:104: 00000100:00100000:1.0:1789683442.815877:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789683442.815887:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:13194:x1876618850176512:12345-0@lo:104: 00010000:00010000:1.0:1789683442.815895:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbc00/0xcf8485587b8896e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8896ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.815987:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789683442.815997:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:13194:x1876618850176512:12345-0@lo:104: Request processed in 114us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683442.816003:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789683442.816016:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789683442.816021:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:13194:x1876618850176640:12345-0@lo:104: 00010000:00010000:1.0:1789683442.816028:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f8454cc00/0xcf8485587b8896d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8896de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816057:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789683442.816062:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:13194:x1876618850176640:12345-0@lo:104: Request processed in 42us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683442.816067:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1789683442.816083:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789683442.816089:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b889701 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889708 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816095:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81391400 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683442.816098:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b889701 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b889708 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816106:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b889701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b889708 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683442.816112:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b889701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b889708 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683442.816118:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789683442.816145:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b889701 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889708 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816161:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683442.816203:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b889701 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889708 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816209:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f81391400/0xcf8485587b889701 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889708 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816223:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789683442.816226:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8896f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8896fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816232:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8000 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683442.816234:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8896f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8896fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816241:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8896f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8896fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683442.816246:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8896f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8896fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683442.816251:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789683442.816264:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8896f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8896fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816270:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683442.816276:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8896f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8896fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816281:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b8896f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8896fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816295:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683442.816298:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbc00/0xcf8485587b8896e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8896ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816304:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dbc00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683442.816306:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbc00/0xcf8485587b8896e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8896ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816313:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbc00/0xcf8485587b8896e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8896ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683442.816319:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbc00/0xcf8485587b8896e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8896ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683442.816335:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789683442.816349:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbc00/0xcf8485587b8896e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8896ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816355:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683442.816369:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbc00/0xcf8485587b8896e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8896ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816376:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbc00/0xcf8485587b8896e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8896ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816384:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683442.816388:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f8454cc00/0xcf8485587b8896d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b8896de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816403:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454cc00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683442.816406:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f8454cc00/0xcf8485587b8896d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b8896de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816413:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f8454cc00/0xcf8485587b8896d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b8896de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683442.816419:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f8454cc00/0xcf8485587b8896d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b8896de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683442.816424:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789683442.816436:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f8454cc00/0xcf8485587b8896d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8896de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816442:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683442.816448:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f8454cc00/0xcf8485587b8896d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8896de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816454:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f8454cc00/0xcf8485587b8896d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b8896de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.816467:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683442.816469:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683442.816471:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683442.816478:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683442.818023:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850176896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683442.818079:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683442.818127:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683442.818133:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850177024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683442.818176:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683442.818212:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683442.818225:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850176896 00000100:00100000:1.0:1789683442.818232:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850176896 00010000:00010000:1.0:1789683442.818261:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0e837da800/0xcf8485587b889708 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889701 expref: 24 pid: 6516 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683442.818286:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850177024 00000100:00100000:1.0:1789683442.818289:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850177024 00010000:00010000:1.0:1789683442.818299:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b8896fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8896f3 expref: 25 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683442.818318:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789683442.818336:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0708700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+25:3647:x1876618850176896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683442.818349:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683442.818354:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0e837da800/0xcf8485587b889708 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889701 expref: 25 pid: 6516 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.818363:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0e837da800/0xcf8485587b889708 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b889701 expref: 25 pid: 6516 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.818378:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837da800/0xcf8485587b889708 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b889701 expref: 25 pid: 6516 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.818391:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683442.818424:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0708700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850176896:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683442.818430:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789683442.818445:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789683442.818452:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0709180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:3647:x1876618850177024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683442.818467:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683442.818471:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b8896fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8896f3 expref: 23 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.818480:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b8896fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b8896f3 expref: 23 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.818490:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b8896fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b8896f3 expref: 23 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.818499:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683442.818521:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0709180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:3647:x1876618850177024:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683442.818526:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789683442.818556:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850177024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683442.818565:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850176896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683442.819394:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850177280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683442.819428:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683442.819458:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683442.819463:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850177152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683442.819481:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683442.819505:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850177280 00000100:00100000:1.0:1789683442.819509:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850177280 00010000:00010000:1.0:1789683442.819528:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0e837da200/0xcf8485587b8896de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8896d7 expref: 22 pid: 6516 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683442.819543:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850177152 00000100:00100000:1.0:1789683442.819552:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850177152 00010000:00010000:1.0:1789683442.819562:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0e837da400/0xcf8485587b8896ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8896e5 expref: 23 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683442.819573:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789683442.819578:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0708e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:3650:x1876618850177280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683442.819910:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683442.819915:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0e837da200/0xcf8485587b8896de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8896d7 expref: 23 pid: 6516 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.819924:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0e837da200/0xcf8485587b8896de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b8896d7 expref: 23 pid: 6516 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.819937:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683442.819969:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0708e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:3650:x1876618850177280:12345-0@lo:103:ldlm_bl.0 Request processed in 390us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683442.819976:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789683442.819993:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789683442.819999:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0709f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:3650:x1876618850177152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683442.820006:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683442.820010:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0e837da400/0xcf8485587b8896ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b8896e5 expref: 22 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.820018:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0e837da400/0xcf8485587b8896ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b8896e5 expref: 22 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683442.820026:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683442.820047:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0709f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:3650:x1876618850177152:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683442.820052:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789683442.820089:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850177152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683442.820097:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850177280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683442.820772:0:13194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837da400/0xcf8485587b8896ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b8896e5 expref: 21 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683442.822387:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683442.823834:0:13194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876618850176512:0@lo:104: 00010000:00010000:3.0:1789683442.823993:0:13194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837da200/0xcf8485587b8896de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b8896d7 expref: 20 pid: 6516 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683442.824008:0:13194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876618850176640:0@lo:104: 00000100:00100000:2.0:1789683442.824540:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683442.824900:0:13194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876618850176128:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789683442.824911:0:13194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83762a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876618850176768:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789683442.824963:0:13194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0f81677200/0xcf8485587b889740 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683442.825864:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835413376 00000100:00100000:3.0:1789683442.825876:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835413376 00010000:00010000:3.0:1789683442.825915:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f81391a00/0xcf8485587b88971d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc487 expref: 13 pid: 6516 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683442.825949:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 44 00000100:00100000:3.0:1789683442.825957:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea7031b9-febc-4826-a965-62f420153ef7+13:2403:x1876618835413376:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683442.825972:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683442.825978:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f81391a00/0xcf8485587b88971d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc487 expref: 13 pid: 6516 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.825990:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f81391a00/0xcf8485587b88971d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc487 expref: 13 pid: 6516 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.826008:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81391a00/0xcf8485587b88971d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc487 expref: 13 pid: 6516 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.826023:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683442.826076:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea7031b9-febc-4826-a965-62f420153ef7+12:2403:x1876618835413376:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 119us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683442.826083:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 44 00000100:00100000:2.0:1789683442.826430:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683442.826564:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835413504 00000100:00100000:3.0:1789683442.826569:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835413504 00010000:00010000:3.0:1789683442.826598:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f8454ce00/0xcf8485587b8896d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc448 expref: 12 pid: 6516 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683442.826633:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 45 00000100:00100000:3.0:1789683442.826654:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb29fb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea7031b9-febc-4826-a965-62f420153ef7+12:2403:x1876618835413504:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683442.826662:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683442.826667:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f8454ce00/0xcf8485587b8896d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc448 expref: 12 pid: 6516 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.826676:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f8454ce00/0xcf8485587b8896d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc448 expref: 12 pid: 6516 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.826687:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f8454ce00/0xcf8485587b8896d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc448 expref: 12 pid: 6516 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.826700:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0f81677200/0xcf8485587b889740 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.826708:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81677200/0xcf8485587b889740 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.826723:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0f81677200/0xcf8485587b889740 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.826731:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0f81677200/0xcf8485587b889740 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.826737:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0f81677200/0xcf8485587b889740 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.826744:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0f81677200/0xcf8485587b889740 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.826750:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683442.826754:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0f81677200/0xcf8485587b889740 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.826769:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0f81677200/0xcf8485587b889740 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.826800:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0f81677200/0xcf8485587b889740 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.826812:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683442.826844:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb29fb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea7031b9-febc-4826-a965-62f420153ef7+11:2403:x1876618835413504:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 191us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683442.826852:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 45 00010000:00010000:3.0:1789683442.826903:0:13194:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0f81677200/0xcf8485587b889740 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.826911:0:13194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0f81677200/0xcf8485587b889740 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683442.826917:0:13194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81677200/0xcf8485587b889740 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683443.300832:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850177664:0@lo:400:kworker.0 00000100:00100000:2.0:1789683443.300907:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683443.300971:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850178176:0@lo:400:kworker.0 00000100:00100000:2.0:1789683443.300996:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683443.301012:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850178688:0@lo:400:kworker.0 00000100:00100000:2.0:1789683443.301031:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683443.301052:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789683443.301058:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850177792:0@lo:400:kworker.0 00000100:00100000:2.0:1789683443.301078:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683443.301100:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850178304:0@lo:400:kworker.0 00000100:00100000:2.0:1789683443.301121:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683443.301136:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850178816:0@lo:400:kworker.0 00000100:00100000:2.0:1789683443.301153:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683443.301192:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850177664 00000100:00100000:2.0:1789683443.301199:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850177664 00000100:00100000:2.0:1789683443.301244:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789683443.301252:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850177664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683443.301311:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850177664:12345-0@lo:400:kworker.0 Request processed in 60us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683443.301317:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789683443.301361:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850177664:0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.301615:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850177536:0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.301653:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683443.301674:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850178048:0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.301693:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683443.301710:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850178560:0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.301729:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683443.301741:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789683443.301747:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850177408:0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.301818:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683443.301842:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850177920:0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.301864:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683443.301879:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850178432:0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.301898:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683443.301914:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850178944:0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.301932:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683443.301956:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850178176 00000100:00100000:3.0:1789683443.301961:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850178176 00000100:00100000:3.0:1789683443.301993:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850178688 00000100:00100000:3.0:1789683443.301996:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850178688 00000100:00100000:3.0:1789683443.302006:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850177792 00000100:00100000:3.0:1789683443.302008:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850177792 00000100:00100000:3.0:1789683443.302016:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850177536 00000100:00100000:3.0:1789683443.302017:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850177536 00000100:00100000:3.0:1789683443.302025:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850178048 00000100:00100000:3.0:1789683443.302027:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850178048 00000100:00100000:3.0:1789683443.302037:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850178560 00000100:00100000:3.0:1789683443.302039:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850178560 00000100:00100000:3.0:1789683443.302050:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789683443.302056:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850178176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.302095:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850178176:12345-0@lo:400:kworker.0 Request processed in 40us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683443.302101:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789683443.302115:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789683443.302121:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850178688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.302148:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850178688:12345-0@lo:400:kworker.0 Request processed in 28us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683443.302174:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789683443.302186:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789683443.302192:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850177792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.302222:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850177792:12345-0@lo:400:kworker.0 Request processed in 30us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683443.302227:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789683443.302238:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789683443.302243:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850177536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.302271:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850177536:12345-0@lo:400:kworker.0 Request processed in 28us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683443.302276:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789683443.302286:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789683443.302291:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850178048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.302314:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850178048:12345-0@lo:400:kworker.0 Request processed in 23us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683443.302320:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789683443.302329:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789683443.302335:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850178560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.302360:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850178560:12345-0@lo:400:kworker.0 Request processed in 26us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683443.302366:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789683443.302383:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850178304 00000100:00100000:3.0:1789683443.302387:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850178304 00000100:00100000:3.0:1789683443.302406:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850178816 00000100:00100000:3.0:1789683443.302408:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850178816 00000100:00100000:3.0:1789683443.302427:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850178432 00000100:00100000:3.0:1789683443.302430:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850178432 00000100:00100000:3.0:1789683443.302440:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850178944 00000100:00100000:3.0:1789683443.302442:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850178944 00000100:00100000:3.0:1789683443.302453:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789683443.302458:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850178304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.302489:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850178304:12345-0@lo:400:kworker.0 Request processed in 31us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683443.302494:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789683443.302505:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789683443.302509:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850178816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.302534:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850178816:12345-0@lo:400:kworker.0 Request processed in 25us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683443.302539:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789683443.302548:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789683443.302553:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850178432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.302576:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850178432:12345-0@lo:400:kworker.0 Request processed in 24us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683443.302582:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789683443.302591:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789683443.302597:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850178944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.302622:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850178944:12345-0@lo:400:kworker.0 Request processed in 25us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683443.302627:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789683443.302656:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850177408 00000100:00100000:3.0:1789683443.302659:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850177408 00000100:00100000:3.0:1789683443.302683:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1789683443.302696:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:3648:x1876618850177408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.302725:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:3648:x1876618850177408:12345-0@lo:400:kworker.0 Request processed in 30us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683443.302731:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1789683443.302759:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850177920 00000100:00100000:3.0:1789683443.302762:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850177920 00000100:00100000:3.0:1789683443.302804:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789683443.302812:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850177920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.302842:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850177920:12345-0@lo:400:kworker.0 Request processed in 31us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683443.302848:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1789683443.302871:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789683443.302874:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789683443.302877:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683443.302879:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683443.303018:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850177408:0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.303030:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850177920:0@lo:400:kworker.0 00010000:00080000:3.0:1789683443.303041:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f89081c00 x1876618850178432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683443.303051:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850178432:0@lo:400:kworker.0 00010000:00080000:3.0:1789683443.303061:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0bda680 x1876618850178944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683443.303068:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850178944:0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.303079:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850177536:0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.303102:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850178048:0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.303112:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850178560:0@lo:400:kworker.0 00000100:00100000:3.0:1789683443.303150:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850177792:0@lo:400:kworker.0 00010000:00080000:3.0:1789683443.303173:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f89080e00 x1876618850178304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683443.303182:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850178304:0@lo:400:kworker.0 00010000:00080000:3.0:1789683443.303192:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f89081880 x1876618850178816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683443.303199:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850178816:0@lo:400:kworker.0 00010000:00080000:3.0:1789683443.303208:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f89080380 x1876618850178176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683443.303214:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850178176:0@lo:400:kworker.0 00010000:00080000:3.0:1789683443.303222:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f89082300 x1876618850178688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683443.303229:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850178688:0@lo:400:kworker.0 00000100:00100000:1.0:1789683443.304408:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683443.304425:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850179072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683443.304492:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683443.304573:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850179072 00000100:00100000:2.0:1789683443.304588:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850179072 00000100:00100000:2.0:1789683443.304644:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789683443.304652:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850179072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683443.304674:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683443.304725:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850179072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683443.304731:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1789683443.304934:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d15500 x1876618850179072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683443.304951:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850179072:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789683443.743206:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683444.183458:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683444.183521:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835413632 00000100:00100000:3.0:1789683444.183531:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835413632 00000100:00100000:3.0:1789683444.183588:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 319 00000100:00100000:3.0:1789683444.183610:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+11:6175:x1876618835413632:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683444.183626:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683444.183644:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81677e00/0xcf8485587b889747 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc4b8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683444.183685:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81677e00/0xcf8485587b889747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4b8 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683444.183696:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81677e00/0xcf8485587b889747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4b8 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683444.183706:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81677e00, rc 0) 00000100:00100000:3.0:1789683444.183763:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+12:6175:x1876618835413632:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 Request processed in 167us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683444.183771:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 319 00000100:00100000:3.0:1789683444.186159:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683444.186377:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835413760 00000100:00100000:2.0:1789683444.186387:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835413760 00000100:00100000:2.0:1789683444.186445:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 320 00000100:00100000:2.0:1789683444.186454:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+12:6175:x1876618835413760:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683444.186769:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+12:6175:x1876618835413760:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 Request processed in 315us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683444.186778:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 320 00000100:00100000:3.0:1789683444.193489:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683444.193623:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835413888 00000100:00100000:2.0:1789683444.193635:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835413888 00000100:00100000:2.0:1789683444.193704:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 321 00000100:00100000:2.0:1789683444.193715:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+12:6175:x1876618835413888:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683444.193888:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+12:6175:x1876618835413888:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 Request processed in 175us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683444.193898:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 321 00000100:00100000:0.0:1789683444.206935:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683444.207773:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835414016 00000100:00100000:1.0:1789683444.207808:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835414016 00000100:00100000:1.0:1789683444.207867:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 322 00000100:00100000:1.0:1789683444.207877:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+12:6175:x1876618835414016:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683444.207894:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683444.207914:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837da800/0xcf8485587b88974e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc4bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683444.207943:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837da800/0xcf8485587b88974e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4bf expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683444.207954:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837da800/0xcf8485587b88974e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4bf expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683444.207963:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da800, rc 0) 00000100:00100000:1.0:1789683444.208021:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:6175:x1876618835414016:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 Request processed in 146us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683444.208037:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 322 00000100:00100000:3.0:1789683444.222206:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683444.222292:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835414144 00000100:00100000:1.0:1789683444.222304:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835414144 00000100:00100000:1.0:1789683444.222360:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 323 00000100:00100000:1.0:1789683444.222371:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:6175:x1876618835414144:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683444.222528:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:6175:x1876618835414144:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 Request processed in 159us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683444.222536:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 323 00000100:00100000:1.0:1789683444.232367:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683444.232439:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835414272 00000100:00100000:2.0:1789683444.232449:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835414272 00000100:00100000:2.0:1789683444.234229:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 324 00000100:00100000:2.0:1789683444.234248:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:6175:x1876618835414272:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683444.234416:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:6175:x1876618835414272:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 Request processed in 174us (2055us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683444.234424:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 324 10000000:01000000:0.0:1789683444.768280:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789683444.768289:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0e827aa000 from 7 10000000:01000000:0.0:1789683444.768294:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789683444.768358:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454d400/0xcf8485587b889755 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683444.768379:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f8454d400/0xcf8485587b889755 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683444.768391:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f8454d400/0xcf8485587b889755 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683444.768430:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850179200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789683444.768521:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683444.768584:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49600 going to sleep for 11 seconds 00000100:00100000:2.0:1789683444.768651:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850179200 00000100:00100000:2.0:1789683444.768660:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850179200 00000100:00100000:2.0:1789683444.768717:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789683444.768727:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850179200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683444.768740:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683444.768752:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b88975c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889755 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683444.768778:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b88975c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889755 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683444.769009:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b88975c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889755 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683444.769019:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f8600, rc 0) 00000100:00100000:2.0:1789683444.769078:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850179200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 352us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683444.769084:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789683444.769233:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850179200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683444.769248:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f8454d400/0xcf8485587b889755 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88975c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683444.769257:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f8454d400/0xcf8485587b889755 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88975c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683444.769323:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850179328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683444.769351:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683444.769381:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49600 going to sleep for 11 seconds 00010000:00010000:1.0:1789683444.769450:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683444.769500:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850179328 00000100:00100000:2.0:1789683444.769505:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850179328 00000100:00100000:2.0:1789683444.769553:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789683444.769561:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850179328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683444.769700:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850179328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683444.769721:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789683444.769951:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850179328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683444.769985:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850179456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683444.770024:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683444.770055:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83c83240 going to sleep for 11 seconds 00000100:00100000:2.0:1789683444.776314:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850179456 00000100:00100000:2.0:1789683444.776331:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850179456 00000100:00100000:2.0:1789683444.776393:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789683444.776403:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850179456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683444.776604:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850179456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (6578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683444.776612:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789683444.779637:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850179456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789683444.784568:0:13250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789683444.788474:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789683444.788562:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789683444.788575:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454d400/0xcf8485587b889755 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88975c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683444.788590:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f8454d400/0xcf8485587b889755 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88975c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683444.788616:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789683444.788619:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0fb62ea800 from 7 10000000:01000000:0.0:1789683444.788621:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789683444.788661:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c600/0xcf8485587b889763 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683444.788668:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c600/0xcf8485587b889763 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683444.788678:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c600/0xcf8485587b889763 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683444.788704:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850179584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789683444.788766:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683444.788850:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683444.789001:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850179584 00000100:00100000:1.0:1789683444.789010:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850179584 00000100:00100000:1.0:1789683444.789068:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789683444.789077:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850179584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683444.789092:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683444.789105:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837db600/0xcf8485587b88976a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889763 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683444.789127:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837db600/0xcf8485587b88976a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889763 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683444.789156:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837db600/0xcf8485587b88976a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889763 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683444.789164:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837db600, rc 0) 00000100:00100000:1.0:1789683444.789209:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850179584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683444.789216:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789683444.789260:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850179584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683444.789273:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c600/0xcf8485587b889763 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88976a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683444.789281:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c600/0xcf8485587b889763 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88976a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683444.789333:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850179712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683444.789354:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683444.789364:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83c83c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683444.789436:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850179712 00000100:00100000:2.0:1789683444.789441:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850179712 00000100:00100000:2.0:1789683444.789471:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789683444.789479:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850179712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683444.789580:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850179712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683444.789587:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1789683444.789774:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850179712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683444.789834:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850179840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683444.789869:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683444.789893:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83c83c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683444.789999:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850179840 00000100:00100000:2.0:1789683444.790003:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850179840 00000100:00100000:2.0:1789683444.790021:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789683444.790027:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850179840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683444.790117:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850179840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683444.790124:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789683444.792565:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850179840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789683444.793721:0:13251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789683444.793961:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789683444.793982:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683444.793993:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c600/0xcf8485587b889763 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88976a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683444.794021:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c600/0xcf8485587b889763 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88976a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683444.794033:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789683444.794044:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0f88c59000 from 7 10000000:01000000:2.0:1789683444.794047:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683444.794082:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b889771 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683444.794090:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b889771 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683444.794100:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b889771 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683444.794125:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850179968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683444.794194:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683444.794227:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e836bd300 going to sleep for 11 seconds 00000100:00100000:0.0:1789683444.794578:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850179968 00000100:00100000:0.0:1789683444.794586:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850179968 00000100:00100000:0.0:1789683444.794632:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1789683444.794641:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850179968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683444.794655:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683444.794668:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454c000/0xcf8485587b889778 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889771 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683444.794692:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454c000/0xcf8485587b889778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889771 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683444.794702:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454c000/0xcf8485587b889778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889771 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683444.794721:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454c000, rc 0) 00000100:00100000:0.0:1789683444.794771:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850179968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683444.794778:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789683444.795534:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850179968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683444.795562:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b889771 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889778 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683444.795572:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b889771 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889778 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683444.795639:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850180096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683444.795674:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683444.795696:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83c83840 going to sleep for 11 seconds 00000100:00100000:0.0:1789683444.796098:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850180096 00000100:00100000:0.0:1789683444.796105:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850180096 00000100:00100000:0.0:1789683444.796147:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789683444.796154:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850180096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683444.796309:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850180096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683444.796315:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789683444.797984:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850180096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683444.798055:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850180224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683444.798124:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683444.798174:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83c83840 going to sleep for 11 seconds 00000100:00100000:2.0:1789683444.798440:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850180224 00000100:00100000:2.0:1789683444.798447:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850180224 00000100:00100000:2.0:1789683444.798494:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789683444.798502:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850180224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683444.798605:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850180224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683444.798613:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789683444.798718:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850180224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789683444.803594:0:13252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789683444.807059:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789683444.807100:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789683444.807113:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b889771 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889778 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683444.807127:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b889771 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889778 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683444.807776:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789683444.807821:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0f8bdba800 from 7 10000000:01000000:2.0:1789683444.807825:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683444.807883:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88977f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683444.807892:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88977f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683444.807903:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88977f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683444.807927:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850180352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683444.807996:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683444.808053:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e836bd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683444.808087:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850180352 00000100:00100000:3.0:1789683444.808095:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850180352 00000100:00100000:3.0:1789683444.808156:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789683444.808165:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850180352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683444.808180:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683444.808191:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81677200/0xcf8485587b889786 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88977f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683444.808221:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81677200/0xcf8485587b889786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88977f expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683444.808232:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81677200/0xcf8485587b889786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88977f expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683444.808241:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81677200, rc 0) 00000100:00100000:3.0:1789683444.808293:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850180352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683444.808300:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789683444.808321:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850180352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683444.808336:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88977f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889786 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683444.808346:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88977f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889786 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683444.808418:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850180480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683444.808445:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683444.808480:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83c83240 going to sleep for 11 seconds 00000100:00100000:2.0:1789683444.808640:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850180480 00000100:00100000:2.0:1789683444.808645:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850180480 00000100:00100000:2.0:1789683444.808685:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789683444.808693:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850180480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683444.808825:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850180480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683444.808833:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1789683444.808970:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850180480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683444.809000:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850180608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683444.809042:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683444.809070:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83c83240 going to sleep for 11 seconds 00000100:00100000:2.0:1789683444.809109:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850180608 00000100:00100000:2.0:1789683444.809114:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850180608 00000100:00100000:2.0:1789683444.809150:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789683444.809157:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850180608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683444.809305:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850180608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683444.809312:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1789683444.809375:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850180608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789683444.810594:0:13253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789683444.810840:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789683444.810863:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789683444.810874:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88977f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889786 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683444.810885:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88977f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889786 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683445.272778:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683445.272852:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683445.272874:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683445.272891:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683445.272925:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683445.272961:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835414400 00000100:00100000:1.0:1789683445.272972:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835414400 00000100:00100000:1.0:1789683445.273025:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 337 00000100:00100000:1.0:1789683445.273035:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:2405:x1876618835414400:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683445.273105:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:2405:x1876618835414400:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 71us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683445.273114:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 337 00000100:00100000:1.0:1789683445.273159:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835414528 00000100:00100000:1.0:1789683445.273172:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835414528 00000100:00100000:1.0:1789683445.273208:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835414656 00000100:00100000:1.0:1789683445.273211:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835414656 00000100:00100000:1.0:1789683445.273223:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835414784 00000100:00100000:1.0:1789683445.273225:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835414784 00000100:00100000:1.0:1789683445.273239:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835414912 00000100:00100000:1.0:1789683445.273241:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835414912 00000100:00100000:1.0:1789683445.273252:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 195 00000100:00100000:1.0:1789683445.273258:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2404:x1876618835414528:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683445.273290:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2404:x1876618835414528:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 32us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683445.273297:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 195 00000100:00100000:1.0:1789683445.273309:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 196 00000100:00100000:1.0:1789683445.273315:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835414656:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683445.273340:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835414656:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 24us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683445.273346:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 196 00000100:00100000:1.0:1789683445.273357:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 197 00000100:00100000:1.0:1789683445.273363:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+5:2404:x1876618835414784:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683445.273384:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+5:2404:x1876618835414784:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 21us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683445.273390:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 197 00000100:00100000:1.0:1789683445.273399:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 198 00000100:00100000:1.0:1789683445.273405:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835414912:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683445.273425:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835414912:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 20us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683445.273437:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 198 00000100:00080000:1.0:1789683445.273564:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789683445.273569:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683445.343115:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683445.343158:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850180736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683445.343293:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683445.343394:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850180736 00000100:00100000:1.0:1789683445.343404:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850180736 00000100:00100000:1.0:1789683445.343457:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789683445.343467:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850180736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683445.343509:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789683445.343558:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850180736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683445.343564:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789683445.343611:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850180736:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789683445.790928:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683445.856000:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850180864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683445.856107:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683445.856262:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850180864 00000100:00100000:2.0:1789683445.856270:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850180864 00000100:00100000:2.0:1789683445.856364:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789683445.856376:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850180864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789683445.856411:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683445.856457:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850180864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683445.856465:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1789683445.856563:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789683445.856594:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d17480 x1876618850180864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683445.856626:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850180864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683446.367440:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850180992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683446.367508:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683446.367598:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850180992 00000100:00100000:1.0:1789683446.367606:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850180992 00000100:00100000:1.0:1789683446.367666:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789683446.367687:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850180992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683446.367718:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683446.367765:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850180992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683446.367771:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1789683446.367842:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0708700 x1876618850180992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683446.367864:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850180992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683446.368642:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683446.368655:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850181120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683446.368707:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683446.368751:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850181120 00000100:00100000:1.0:1789683446.368759:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850181120 00000100:00100000:1.0:1789683446.368810:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789683446.368819:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850181120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683446.368847:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789683446.368888:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850181120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683446.368894:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789683446.368927:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850181120:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1789683446.370955:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789683446.818141:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789683447.116078:0:13392:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789683447.844345:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683447.903045:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850181248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683447.903161:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683447.903931:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850181248 00000100:00100000:1.0:1789683447.903942:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850181248 00000100:00100000:1.0:1789683447.904010:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789683447.904019:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850181248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789683447.904052:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789683447.905577:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683447.910998:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850181248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6968us (7825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683447.911015:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1789683447.916749:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d16d80 x1876618850181248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683447.916780:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850181248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683448.415245:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850181376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683448.415343:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683448.415541:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850181376 00000100:00100000:2.0:1789683448.415552:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850181376 00000100:00100000:2.0:1789683448.415617:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789683448.415626:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850181376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683448.415649:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683448.415693:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850181376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683448.415700:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1789683448.415761:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789683448.415827:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d14380 x1876618850181376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683448.415846:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850181376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683448.416735:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850181888:0@lo:400:kworker.0 00000100:00100000:3.0:1789683448.416776:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683448.416819:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850182400:0@lo:400:kworker.0 00000100:00100000:3.0:1789683448.416845:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683448.416861:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850182912:0@lo:400:kworker.0 00000100:00100000:3.0:1789683448.416881:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683448.416899:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789683448.416905:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850181760:0@lo:400:kworker.0 00000100:00100000:3.0:1789683448.416927:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683448.416944:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850182272:0@lo:400:kworker.0 00000100:00100000:3.0:1789683448.416961:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683448.416973:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850182784:0@lo:400:kworker.0 00000100:00100000:3.0:1789683448.416989:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683448.417012:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850182400 00000100:00100000:3.0:1789683448.417018:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850182400 00000100:00100000:3.0:1789683448.417056:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850182912 00000100:00100000:3.0:1789683448.417059:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850182912 00000100:00100000:3.0:1789683448.417093:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789683448.417101:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850182400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683448.417144:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850182400:12345-0@lo:400:kworker.0 Request processed in 44us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683448.417164:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789683448.417179:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789683448.417185:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850182912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683448.417334:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850182912:12345-0@lo:400:kworker.0 Request processed in 148us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683448.417341:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789683448.417366:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850181760 00000100:00100000:3.0:1789683448.417370:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850181760 00000100:00100000:3.0:1789683448.417394:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789683448.417402:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850181760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683448.417434:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850181760:12345-0@lo:400:kworker.0 Request processed in 33us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683448.417440:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1789683448.417462:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683448.417486:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850181760:0@lo:400:kworker.0 00010000:00080000:3.0:1789683448.417499:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb79b4e00 x1876618850182400/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683448.417510:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850182400:0@lo:400:kworker.0 00010000:00080000:3.0:1789683448.417520:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb61f2d80 x1876618850182912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683448.417610:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850182912:0@lo:400:kworker.0 00000100:00100000:2.0:1789683448.417708:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850181632:0@lo:400:kworker.0 00000100:00100000:2.0:1789683448.417739:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683448.417770:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850182144:0@lo:400:kworker.0 00000100:00100000:2.0:1789683448.417809:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683448.417828:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850182656:0@lo:400:kworker.0 00000100:00100000:2.0:1789683448.417848:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683448.417861:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789683448.417866:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850181504:0@lo:400:kworker.0 00000100:00100000:2.0:1789683448.417891:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683448.417915:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850182016:0@lo:400:kworker.0 00000100:00100000:2.0:1789683448.417934:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683448.417957:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850182528:0@lo:400:kworker.0 00000100:00100000:2.0:1789683448.417975:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683448.417997:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850181504 00000100:00100000:2.0:1789683448.418001:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850181504 00000100:00100000:2.0:1789683448.418024:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789683448.418029:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850181504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683448.418061:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850181504:12345-0@lo:400:kworker.0 Request processed in 32us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683448.418081:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789683448.418116:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850181504:0@lo:400:kworker.0 00000100:00100000:1.0:1789683448.418395:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850181888 00000100:00100000:1.0:1789683448.418402:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850181888 00000100:00100000:1.0:1789683448.418435:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850182272 00000100:00100000:1.0:1789683448.418439:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850182272 00000100:00100000:1.0:1789683448.418474:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850182784 00000100:00100000:1.0:1789683448.418477:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850182784 00000100:00100000:1.0:1789683448.418490:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850181632 00000100:00100000:1.0:1789683448.418492:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850181632 00000100:00100000:1.0:1789683448.418502:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850182144 00000100:00100000:1.0:1789683448.418504:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850182144 00000100:00100000:1.0:1789683448.418516:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850182656 00000100:00100000:1.0:1789683448.418519:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850182656 00000100:00100000:1.0:1789683448.418542:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789683448.418550:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850181888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683448.418599:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850181888:12345-0@lo:400:kworker.0 Request processed in 50us (1823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683448.418605:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789683448.418619:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789683448.418625:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850182272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683448.418652:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850182272:12345-0@lo:400:kworker.0 Request processed in 28us (1690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683448.418658:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789683448.418669:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789683448.418674:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850182784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683448.418700:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850182784:12345-0@lo:400:kworker.0 Request processed in 26us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683448.418705:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789683448.418717:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789683448.418722:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850181632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683448.418754:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850181632:12345-0@lo:400:kworker.0 Request processed in 32us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683448.418767:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789683448.418779:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789683448.418803:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850182144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683448.418836:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850182144:12345-0@lo:400:kworker.0 Request processed in 52us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683448.418841:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789683448.418854:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789683448.418859:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850182656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683448.418884:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850182656:12345-0@lo:400:kworker.0 Request processed in 26us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683448.418889:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789683448.418913:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850182016 00000100:00100000:1.0:1789683448.418917:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850182016 00000100:00100000:1.0:1789683448.418940:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789683448.418945:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850182016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683448.418977:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850182016:12345-0@lo:400:kworker.0 Request processed in 31us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683448.418983:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789683448.419025:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850182016:0@lo:400:kworker.0 00000100:00100000:1.0:1789683448.419036:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850181632:0@lo:400:kworker.0 00000100:00100000:1.0:1789683448.419044:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850182144:0@lo:400:kworker.0 00000100:00100000:1.0:1789683448.419053:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850182656:0@lo:400:kworker.0 00010000:00080000:1.0:1789683448.419099:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb79b6680 x1876618850182272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683448.419118:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850182272:0@lo:400:kworker.0 00010000:00080000:1.0:1789683448.419132:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb61f2680 x1876618850182784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683448.419140:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850182784:0@lo:400:kworker.0 00000100:00100000:1.0:1789683448.419150:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850181888:0@lo:400:kworker.0 00000100:00080000:2.0:1789683448.419482:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683448.419487:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683448.419659:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850182528 00000100:00100000:3.0:1789683448.419664:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850182528 00000100:00100000:3.0:1789683448.419715:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789683448.419730:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850182528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683448.419779:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850182528:12345-0@lo:400:kworker.0 Request processed in 51us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683448.419803:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1789683448.419833:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7244e00 x1876618850182528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683448.419844:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850182528:0@lo:400:kworker.0 00000100:00080000:2.0:1789683448.419899:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789683448.863194:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683449.888142:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683450.397334:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683450.397403:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683450.397440:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683450.397458:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683450.397480:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683450.397721:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835415296 00000100:00100000:0.0:1789683450.397732:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835415296 00000100:00100000:0.0:1789683450.397832:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835415552 00000100:00100000:0.0:1789683450.397836:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835415552 00000100:00100000:0.0:1789683450.397852:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835415168 00000100:00100000:0.0:1789683450.397855:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835415168 00000100:00100000:0.0:1789683450.397867:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835415424 00000100:00100000:0.0:1789683450.397869:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835415424 00000100:00100000:0.0:1789683450.397887:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 205 00000100:00100000:0.0:1789683450.397897:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835415296:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683450.397975:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835415296:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 80us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683450.397997:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 205 00000100:00100000:0.0:1789683450.398015:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 206 00000100:00100000:0.0:1789683450.398021:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835415552:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683450.398059:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835415552:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 38us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683450.398065:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 206 00000100:00100000:0.0:1789683450.398076:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 207 00000100:00100000:0.0:1789683450.398082:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835415168:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683450.398107:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835415168:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 26us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683450.398112:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 207 00000100:00100000:0.0:1789683450.398123:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 208 00000100:00100000:0.0:1789683450.398129:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835415424:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683450.398152:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835415424:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 24us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683450.398158:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 208 00000100:00080000:0.0:1789683450.398174:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683450.398178:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683450.398384:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835415040 00000100:00100000:1.0:1789683450.398388:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835415040 00000100:00100000:1.0:1789683450.398425:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 339 00000100:00100000:1.0:1789683450.398431:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:2402:x1876618835415040:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683450.398458:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:2402:x1876618835415040:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 28us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683450.398464:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 339 00000100:00100000:3.0:1789683450.470897:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850183040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683450.470984:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683450.471155:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850183040 00000100:00100000:1.0:1789683450.471166:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850183040 00000100:00100000:1.0:1789683450.471224:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789683450.471235:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850183040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683450.471271:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789683450.471350:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850183040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683450.471368:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789683450.478450:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850183040:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789683450.911746:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683450.981423:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683450.981444:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850183168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683450.981526:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683450.981588:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850183168 00000100:00100000:2.0:1789683450.981600:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850183168 00000100:00100000:2.0:1789683450.981663:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789683450.981671:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850183168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789683450.981703:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683450.981748:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850183168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683450.981756:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1789683450.981813:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d17b80 x1876618850183168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683450.981831:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850183168:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789683450.983432:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683451.487004:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683451.487038:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850183296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683451.487103:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683451.487166:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850183296 00000100:00100000:1.0:1789683451.487172:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850183296 00000100:00100000:1.0:1789683451.487211:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789683451.487220:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850183296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683451.487259:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789683451.493328:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850183296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6099us (6214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683451.493342:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789683451.493407:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850183424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683451.493481:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683451.493555:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850183296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683451.493590:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850183424 00000100:00100000:1.0:1789683451.493596:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850183424 00000100:00100000:1.0:1789683451.493639:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789683451.493648:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850183424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683451.493670:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683451.493709:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850183424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683451.493716:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1789683451.493732:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789683451.493753:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb79b4e00 x1876618850183424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683451.493769:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850183424:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789683451.935436:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789683452.930826:0:13541:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 18:17:31 (1789683451) === 00010000:00010000:3.0:1789683452.960280:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683453.025135:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850183552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683453.025221:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683453.027028:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850183552 00000100:00100000:3.0:1789683453.027042:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850183552 00000100:00100000:3.0:1789683453.027124:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789683453.027134:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850183552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789683453.027167:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683453.027236:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850183552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (2016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683453.027243:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1789683453.027301:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb79b4e00 x1876618850183552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683453.027320:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850183552:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789683453.027655:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683453.238734:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683453.238800:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683453.239067:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835415680 00000100:00100000:0.0:1789683453.239080:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835415680 00000100:00100000:0.0:1789683453.239163:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:0.0:1789683453.239175:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835415680:12345-192.168.201.50@tcp:41:mkdir.0 00000004:00000024:0.0:1789683453.239235:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789683453.239338:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835415680:12345-192.168.201.50@tcp:41:mkdir.0 Request processed in 165us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683453.239345:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00080000:3.0:1789683453.239658:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683453.239700:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835415808 00000100:00100000:2.0:1789683453.239705:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835415808 00000100:00100000:2.0:1789683453.239774:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:2.0:1789683453.239804:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ec036ece-1720-411a-849c-c978dbb41f8a+6:10492:x1876618835415808:12345-192.168.201.50@tcp:700:mkdir.0 00000100:00100000:2.0:1789683453.240145:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ec036ece-1720-411a-849c-c978dbb41f8a+6:10492:x1876618835415808:12345-192.168.201.50@tcp:700:mkdir.0 Request processed in 362us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683453.240153:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:1.0:1789683453.253668:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683453.253779:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835416064 00000100:00100000:2.0:1789683453.254070:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835416064 00000100:00100000:0.0:1789683453.254397:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:0.0:1789683453.254411:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:10492:x1876618835416064:12345-192.168.201.50@tcp:36:mkdir.0 00010000:00010000:0.0:1789683453.254479:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683453.254556:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88962f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc433 expref: 6 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.254578:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f853e3300) 00010000:00010000:0.0:1789683453.254590:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789683453.254681:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88978d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.254696:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88978d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.254707:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88978d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.254733:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d200/0xcf8485587b889794 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.254741:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d200/0xcf8485587b889794 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.254748:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d200/0xcf8485587b889794 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.255626:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88979b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.255640:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88979b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.255647:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88979b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789683453.255662:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bd23c2c reply state 0000000073c60448 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88979b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.255672:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88979b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.255678:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0e835acf00) 00010000:00010000:0.0:1789683453.255681:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789683453.255684:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789683453.255689:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789683453.255696:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88978d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.255702:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88978d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.255709:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88978d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.255715:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683453.255719:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88978d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.255738:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88978d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.255747:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e835ac000) 00010000:00010000:0.0:1789683453.255750:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683453.255754:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88978d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.255759:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88978d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789683453.255774:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bd23c2c reply state 0000000073c60448 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d200/0xcf8485587b889794 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.256140:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d200/0xcf8485587b889794 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.256149:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f0e835ace00) 00010000:00010000:0.0:1789683453.256152:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789683453.256154:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789683453.256264:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:10492:x1876618835416064:12345-192.168.201.50@tcp:36:mkdir.0 Request processed in 1854us (2603us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789683453.256272:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:3.0:1789683453.276575:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683453.276861:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835416192 00000100:00100000:1.0:1789683453.276872:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835416192 00000100:00100000:1.0:1789683453.277058:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:1.0:1789683453.277069:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+7:10494:x1876618835416192:12345-192.168.201.50@tcp:101:chmod.0 00010000:00010000:1.0:1789683453.277093:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683453.277120:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da400/0xcf8485587b8897a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc4c6 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.277189:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b8897a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.277203:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b8897a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.277218:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b8897a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683453.277277:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789683453.277281:0:12533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789683453.277319:0:12533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b8897a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.277348:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da400/0xcf8485587b8897a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4c6 expref: 9 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.277368:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b8897a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4c6 expref: 8 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.277391:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f926bb400) 00010000:00010000:1.0:1789683453.277394:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683453.277398:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837daa00, rc 0) 00000100:00100000:1.0:1789683453.277479:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+8:10494:x1876618835416192:12345-192.168.201.50@tcp:101:chmod.0 Request processed in 412us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683453.277486:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:2.0:1789683453.290668:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683453.290757:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835416448 00000100:00100000:3.0:1789683453.290768:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835416448 00000100:00100000:3.0:1789683453.290870:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:3.0:1789683453.290880:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+8:10494:x1876618835416448:12345-192.168.201.50@tcp:36:chmod.0 00010000:00010000:3.0:1789683453.290947:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683453.290990:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b8897a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4c6 expref: 8 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.291012:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f926bb400) 00010000:00010000:3.0:1789683453.291022:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683453.291047:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b8897b0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.291060:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b8897b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.291069:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b8897b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683453.291282:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecd2458d reply state 000000007a07b57f transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b8897b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.291297:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b8897b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.291316:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fc11eb300) 00010000:00010000:3.0:1789683453.291318:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789683453.291322:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789683453.291331:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789683453.291414:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+9:10494:x1876618835416448:12345-192.168.201.50@tcp:36:chmod.0 Request processed in 534us (754us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789683453.291422:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:2.0:1789683453.313072:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683453.313178:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835416576 00000100:00100000:0.0:1789683453.313190:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835416576 00000100:00100000:0.0:1789683453.313318:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 26 00000100:00100000:0.0:1789683453.313328:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+9:10495:x1876618835416576:12345-192.168.201.50@tcp:101:chown.0 00010000:00010000:0.0:1789683453.313354:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683453.313374:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b8897b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc4cd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.313460:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b8897be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.313474:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b8897be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.313487:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b8897be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683453.313530:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789683453.313533:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683453.313574:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b8897be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.313603:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b8897b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4cd expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.313624:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b8897be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4cd expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.313632:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fc11eb300) 00010000:00010000:0.0:1789683453.313635:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683453.313639:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454cc00, rc 0) 00000100:00100000:0.0:1789683453.314013:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+10:10495:x1876618835416576:12345-192.168.201.50@tcp:101:chown.0 Request processed in 685us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683453.314021:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 26 00000100:00100000:0.0:1789683453.328350:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683453.328446:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835416704 00000100:00100000:1.0:1789683453.328466:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835416704 00000100:00100000:1.0:1789683453.328531:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:1.0:1789683453.328542:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+10:10495:x1876618835416704:12345-192.168.201.50@tcp:101:chown.0 00010000:00010000:1.0:1789683453.328566:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683453.328591:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da400/0xcf8485587b8897c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc4d4 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.328662:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b8897cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.328676:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b8897cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.328687:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b8897cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.328697:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8897d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.328705:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8897d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.328729:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8897d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.328843:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dba00/0xcf8485587b8897da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.328863:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dba00/0xcf8485587b8897da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.328870:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dba00/0xcf8485587b8897da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683453.329078:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789683453.329083:0:12533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683453.329174:0:12533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dba00/0xcf8485587b8897da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.329193:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b8897cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.329200:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b8897cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.329206:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b8897cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.329213:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837da200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683453.329217:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b8897cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.329225:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b8897cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.329238:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fc11eb300) 00010000:00010000:0.0:1789683453.329241:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683453.329245:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b8897cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.329250:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b8897cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.329264:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8897d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.329270:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8897d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.329276:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8897d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.329287:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dbc00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683453.329290:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8897d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.329296:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8897d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.329303:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f0e835ace00) 00010000:00010000:0.0:1789683453.329306:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683453.329308:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8897d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.329314:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8897d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.329341:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da400/0xcf8485587b8897c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4d4 expref: 12 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.329353:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dba00/0xcf8485587b8897da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4d4 expref: 11 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.329360:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0e835acf00) 00010000:00010000:0.0:1789683453.329362:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683453.329364:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dba00, rc 0) 00000100:00100000:0.0:1789683453.329433:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+11:10495:x1876618835416704:12345-192.168.201.50@tcp:101:chown.0 Request processed in 893us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683453.329441:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:2.0:1789683453.335247:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683453.335642:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835416832 00000100:00100000:0.0:1789683453.335668:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835416832 00000100:00100000:0.0:1789683453.335734:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:0.0:1789683453.335743:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ec036ece-1720-411a-849c-c978dbb41f8a+11:10495:x1876618835416832:12345-192.168.201.50@tcp:900:chown.0 00000100:00100000:0.0:1789683453.335871:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ec036ece-1720-411a-849c-c978dbb41f8a+11:10495:x1876618835416832:12345-192.168.201.50@tcp:900:chown.0 Request processed in 128us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683453.335879:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:2.0:1789683453.350952:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683453.351172:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835417088 00000100:00100000:1.0:1789683453.351184:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835417088 00000100:00100000:1.0:1789683453.351251:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:1.0:1789683453.351261:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+11:10495:x1876618835417088:12345-192.168.201.50@tcp:36:chown.0 00010000:00010000:1.0:1789683453.351319:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683453.351346:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dba00/0xcf8485587b8897da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4d4 expref: 11 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.351366:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0e835acf00) 00010000:00010000:1.0:1789683453.351371:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789683453.351393:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db200/0xcf8485587b8897e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.351405:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db200/0xcf8485587b8897e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.351429:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db200/0xcf8485587b8897e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789683453.353762:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:2.0:1789683453.354057:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d200/0xcf8485587b889794 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354071:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d200/0xcf8485587b889794 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354079:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d200/0xcf8485587b889794 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354086:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683453.354090:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d200/0xcf8485587b889794 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354096:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d200/0xcf8485587b889794 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354112:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f0e835ace00) 00010000:00010000:2.0:1789683453.354122:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683453.354127:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d200/0xcf8485587b889794 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354133:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d200/0xcf8485587b889794 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354151:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88979b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354156:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88979b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354161:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88979b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354166:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683453.354169:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88979b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354174:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88979b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354181:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0e835acf00) 00010000:00010000:2.0:1789683453.354183:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683453.354185:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88979b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354191:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88979b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354204:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b8897b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354220:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b8897b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354226:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b8897b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354231:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81676c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683453.354234:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b8897b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354241:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b8897b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354248:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fc11eb300) 00010000:00010000:2.0:1789683453.354251:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789683453.354254:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b8897b0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.354260:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b8897b0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789683453.354423:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002572e76d reply state 000000000cea4019 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db200/0xcf8485587b8897e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.354438:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db200/0xcf8485587b8897e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.354455:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0e835acf00) 00010000:00010000:1.0:1789683453.354457:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789683453.354460:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789683453.354472:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1789683453.354566:0:6521:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789683453.355084:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+7:10495:x1876618835417088:12345-192.168.201.50@tcp:36:chown.0 Request processed in 3819us (4136us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789683453.355094:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 28 00010000:00010000:0.0:1789683453.363516:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db200/0xcf8485587b8897e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.363534:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db200/0xcf8485587b8897e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.363603:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db200/0xcf8485587b8897e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.363612:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837db200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683453.363617:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db200/0xcf8485587b8897e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.363625:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db200/0xcf8485587b8897e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.363641:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0e835acf00) 00010000:00010000:0.0:1789683453.363644:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789683453.363650:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db200/0xcf8485587b8897e1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.363657:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db200/0xcf8485587b8897e1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683453.384135:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683453.384201:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835417216 00000100:00100000:0.0:1789683453.384226:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835417216 00000100:00100000:0.0:1789683453.384314:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:0.0:1789683453.384324:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:10496:x1876618835417216:12345-192.168.201.50@tcp:101:touch.500 00010000:00010000:0.0:1789683453.384353:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683453.384374:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b8897e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc4db expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789683453.400033:0:6522:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 15605us 00010000:00010000:0.0:1789683453.423868:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8897ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.423892:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8897ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.423906:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8897ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.423921:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8897f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.423928:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8897f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.423935:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8897f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424060:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b8897fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424068:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b8897fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424084:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b8897fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683453.424113:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789683453.424117:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683453.424148:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b8897fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424159:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8897ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424165:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8897ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424172:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8897ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424177:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454ce00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683453.424181:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8897ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424188:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8897ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424199:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fc11eb300) 00010000:00010000:0.0:1789683453.424201:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683453.424207:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8897ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424213:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8897ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424232:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8897f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424239:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8897f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424244:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8897f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424249:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454de00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683453.424252:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8897f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424258:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8897f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424265:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f0e835acf00) 00010000:00010000:0.0:1789683453.424268:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683453.424271:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8897f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424276:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8897f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424310:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b8897e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4db expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424324:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b8897fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4db expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.424352:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0e835ac000) 00010000:00010000:0.0:1789683453.424354:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789683453.424357:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d600, rc 0) 00000100:00100000:0.0:1789683453.424432:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:10496:x1876618835417216:12345-192.168.201.50@tcp:101:touch.500 Request processed in 40108us (40304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683453.424450:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:3.0:1789683453.432514:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683453.434129:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835417472 00000100:00100000:0.0:1789683453.434144:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835417472 00000100:00100000:0.0:1789683453.434211:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:0.0:1789683453.434222:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+7:10496:x1876618835417472:12345-192.168.201.50@tcp:101:touch.500 00010000:00010000:0.0:1789683453.434244:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683453.434265:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c200/0xcf8485587b889804 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc4e2 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.434367:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88980b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.434382:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88980b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.434395:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88980b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.434469:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889812 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.434477:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889812 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.434500:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889812 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789683453.434902:0:8462:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789683453.435061:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889819 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.435071:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.435078:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.435112:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88980b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.435119:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88980b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.435126:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88980b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.435132:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454dc00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683453.435135:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88980b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.435143:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88980b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.435154:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0e835ac000) 00010000:00010000:0.0:1789683453.435157:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683453.435171:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88980b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.435177:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88980b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789683453.435191:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067c32875 reply state 0000000087455712 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889812 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.435202:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889812 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.435208:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff9f0e835ac900) 00010000:00010000:0.0:1789683453.435210:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789683453.435212:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789683453.435243:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c200/0xcf8485587b889804 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4e2 expref: 10 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.435257:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889819 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4e2 expref: 9 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.435264:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f0e835acc00) 00010000:00010000:0.0:1789683453.435267:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683453.435269:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454da00, rc 0) 00000100:00100000:0.0:1789683453.435341:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+10:10496:x1876618835417472:12345-192.168.201.50@tcp:101:touch.500 Request processed in 1121us (2835us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789683453.435348:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:3.0:1789683453.440687:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683453.441022:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835417728 00000100:00100000:2.0:1789683453.441033:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835417728 00000100:00100000:2.0:1789683453.441086:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:2.0:1789683453.441098:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+10:10496:x1876618835417728:12345-192.168.201.50@tcp:36:touch.500 00010000:00010000:2.0:1789683453.441160:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683453.441188:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889819 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4e2 expref: 10 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.441225:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f0e835acc00) 00010000:00010000:2.0:1789683453.441238:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683453.441295:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b889827 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.441307:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b889827 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.441317:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b889827 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683453.441927:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8edc541 reply state 00000000ca06102c transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b889827 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.441943:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b889827 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.441950:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f0f83e0b400) 00010000:00010000:2.0:1789683453.441954:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789683453.441956:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683453.442070:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+11:10496:x1876618835417728:12345-192.168.201.50@tcp:36:touch.500 Request processed in 973us (1392us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789683453.442078:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:0.0:1789683453.451580:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683453.451652:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835417856 00000100:00100000:2.0:1789683453.451662:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835417856 00000100:00100000:2.0:1789683453.451729:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 32 00000100:00100000:2.0:1789683453.451737:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+11:10496:x1876618835417856:12345-192.168.201.50@tcp:101:touch.500 00010000:00010000:2.0:1789683453.451760:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683453.451830:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88982e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc4e9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.451888:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88982e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4e9 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.451903:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88982e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4e9 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.451920:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f0f83e0b400) 00010000:00010000:2.0:1789683453.451923:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683453.451927:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f9c00, rc 0) 00000100:00100000:2.0:1789683453.451991:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+12:10496:x1876618835417856:12345-192.168.201.50@tcp:101:touch.500 Request processed in 254us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683453.451998:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 32 00000100:00100000:3.0:1789683453.460127:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683453.460229:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835417984 00000100:00100000:0.0:1789683453.460240:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835417984 00000100:00100000:0.0:1789683453.460308:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:0.0:1789683453.460317:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1876618835417984:12345-192.168.201.50@tcp:8:touch.500 00010000:00080000:0.0:1789683453.460354:0:8676:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp t0 exp 0000000000000000 cur 367 last 0 00000020:00000080:0.0:1789683453.460391:0:8676:0:(genops.c:1384:class_connect()) connect: client ec036ece-1720-411a-849c-c978dbb41f8a, cookie 0xcf8485587b889835 00002000:00100000:0.0:1789683453.460403:0:8676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ec036ece-1720-411a-849c-c978dbb41f8a/ffff9f0e83d4c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789683453.460421:0:8676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:0.0:1789683453.460499:0:8676:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789683453.460527:0:8676:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d4a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683453.460615:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec036ece-1720-411a-849c-c978dbb41f8a+6:2401:x1876618835417984:12345-192.168.201.50@tcp:8:touch.500 Request processed in 297us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683453.460623:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:3.0:1789683453.462558:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683453.462653:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835418112 00000100:00100000:0.0:1789683453.462664:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835418112 00000100:00100000:0.0:1789683453.462744:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:0.0:1789683453.462754:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:0:x1876618835418112:12345-192.168.201.50@tcp:2:touch.500 00000100:00080000:3.0:1789683453.463249:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789683453.475073:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:1.0:1789683453.475087:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec036ece-1720-411a-849c-c978dbb41f8a 00000100:00100000:0.0:1789683453.475323:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:0:x1876618835418112:12345-192.168.201.50@tcp:2:touch.500 Request processed in 12566us (12778us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789683453.475350:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:1.0:1789683453.486883:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683453.487040:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835418368 00000100:00100000:2.0:1789683453.487052:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835418368 00000100:00100000:2.0:1789683453.487127:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:2.0:1789683453.487141:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+12:10496:x1876618835418368:12345-192.168.201.50@tcp:35:touch.500 00000100:00100000:2.0:1789683453.487467:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+13:10496:x1876618835418368:12345-192.168.201.50@tcp:35:touch.500 Request processed in 328us (594us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789683453.487475:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:3.0:1789683453.502538:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683453.502645:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835418496 00000100:00100000:1.0:1789683453.502655:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835418496 00000100:00100000:1.0:1789683453.502769:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:1.0:1789683453.502778:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+13:10497:x1876618835418496:12345-192.168.201.50@tcp:101:rm.0 00010000:00010000:1.0:1789683453.502833:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683453.502850:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db400/0xcf8485587b88983c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc4f0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.502924:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b889843 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.502935:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b889843 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.502943:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b889843 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683453.502991:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789683453.502995:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789683453.503040:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b889843 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.503067:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db400/0xcf8485587b88983c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4f0 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.503085:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b889843 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4f0 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683453.503094:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0e835ac000) 00010000:00010000:1.0:1789683453.503096:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683453.503100:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dae00, rc 0) 00000100:00100000:1.0:1789683453.503156:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+14:10497:x1876618835418496:12345-192.168.201.50@tcp:101:rm.0 Request processed in 379us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683453.503164:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:0.0:1789683453.506864:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683453.506914:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835418752 00000100:00100000:2.0:1789683453.506925:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835418752 00000100:00100000:2.0:1789683453.507000:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:2.0:1789683453.507010:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+14:10497:x1876618835418752:12345-192.168.201.50@tcp:101:rm.0 00010000:00010000:2.0:1789683453.507032:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683453.507069:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88984a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc4f7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683453.507175:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789683453.507311:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88984a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4f7 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.507326:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fc11eb300) 00010000:00010000:2.0:1789683453.507329:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789683453.507334:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88984a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4f7 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.507347:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f8800, rc 0) 00000100:00100000:2.0:1789683453.508214:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+15:10497:x1876618835418752:12345-192.168.201.50@tcp:101:rm.0 Request processed in 1201us (1351us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1789683453.508225:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:0.0:1789683453.512126:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683453.512230:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835418880 00000100:00100000:2.0:1789683453.512241:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835418880 00000100:00100000:2.0:1789683453.512410:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:2.0:1789683453.512421:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+15:10497:x1876618835418880:12345-192.168.201.50@tcp:37:rm.0 00000100:00100000:2.0:1789683453.517680:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+15:10497:x1876618835418880:12345-192.168.201.50@tcp:37:rm.0 Request processed in 5246us (5548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683453.517695:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:0.0:1789683453.521368:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683453.521649:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835419136 00000100:00100000:3.0:1789683453.521661:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835419136 00000100:00100000:3.0:1789683453.521757:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:3.0:1789683453.521769:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f867ce850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+15:10497:x1876618835419136:12345-192.168.201.50@tcp:35:rm.0 00000100:00100000:3.0:1789683453.522063:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f867ce850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+16:10497:x1876618835419136:12345-192.168.201.50@tcp:35:rm.0 Request processed in 297us (706us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789683453.522072:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:0.0:1789683453.525235:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683453.525386:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835419392 00000100:00100000:3.0:1789683453.525409:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835419392 00000100:00100000:3.0:1789683453.525486:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00100000:3.0:1789683453.525497:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+16:10497:x1876618835419392:12345-192.168.201.50@tcp:101:rm.0 00010000:00010000:3.0:1789683453.525522:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683453.525780:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676e00/0xcf8485587b889858 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc4fe expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.525922:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677a00/0xcf8485587b88985f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.525936:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677a00/0xcf8485587b88985f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.525949:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677a00/0xcf8485587b88985f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683453.525961:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789683453.526079:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676e00/0xcf8485587b889858 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4fe expref: 19 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.526101:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677a00/0xcf8485587b88985f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4fe expref: 18 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.526110:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0e835ac000) 00010000:00010000:3.0:1789683453.526113:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789683453.526117:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81677a00, rc 0) 00000100:00100000:3.0:1789683453.526172:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+18:10497:x1876618835419392:12345-192.168.201.50@tcp:101:rm.0 Request processed in 677us (946us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789683453.526179:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00100000:1.0:1789683453.529334:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683453.529430:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835419520 00000100:00100000:0.0:1789683453.529624:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835419520 00000100:00100000:0.0:1789683453.529745:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 36 00000100:00100000:0.0:1789683453.529756:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+18:10497:x1876618835419520:12345-192.168.201.50@tcp:41:rm.0 00000004:00000024:0.0:1789683453.529874:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1789683453.529944:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+18:10497:x1876618835419520:12345-192.168.201.50@tcp:41:rm.0 Request processed in 190us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683453.529952:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 36 00000100:00100000:1.0:1789683453.533315:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683453.534955:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835419648 00000100:00100000:2.0:1789683453.534970:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835419648 00000100:00100000:2.0:1789683453.535050:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 37 00000100:00100000:2.0:1789683453.535061:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+18:10497:x1876618835419648:12345-192.168.201.50@tcp:101:rm.0 00010000:00010000:2.0:1789683453.536379:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683453.536411:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88986d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc505 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.536507:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b889874 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.536524:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b889874 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.536538:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b889874 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.536650:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88987b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.536659:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88987b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.536667:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88987b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.536780:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b889882 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.536813:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b889882 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.536820:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b889882 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683453.536864:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789683453.536877:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683453.536902:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b889882 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.536915:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b889882 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.536924:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b889874 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.536929:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b889874 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.536936:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b889874 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.536942:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683453.536947:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b889874 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.536955:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b889874 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.536970:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0e835ac000) 00010000:00010000:2.0:1789683453.536983:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683453.536989:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b889874 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.536996:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b889874 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.537009:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88987b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.537025:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88987b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.537031:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88987b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.537036:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683453.537039:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88987b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.537045:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88987b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.537055:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff9f0e835ac900) 00010000:00010000:2.0:1789683453.537057:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683453.537060:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88987b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.537066:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88987b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.537099:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88986d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc505 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.537114:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b889882 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc505 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683453.537121:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f0f83e0b400) 00010000:00010000:2.0:1789683453.537124:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683453.537132:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30c00, rc 0) 00000100:00100000:2.0:1789683453.537218:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+19:10497:x1876618835419648:12345-192.168.201.50@tcp:101:rm.0 Request processed in 2157us (3914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683453.537226:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 37 00000100:00100000:0.0:1789683453.538080:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683453.538105:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850183680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683453.538167:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683453.538232:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850183680 00000100:00100000:0.0:1789683453.538240:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850183680 00000100:00100000:0.0:1789683453.538306:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789683453.538314:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850183680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683453.538335:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683453.538374:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850183680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683453.538381:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1789683453.538401:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789683453.538428:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0bdaa00 x1876618850183680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683453.538459:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850183680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683453.541156:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683453.541375:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835419904 00000100:00100000:3.0:1789683453.541385:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835419904 00000100:00100000:3.0:1789683453.541456:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 38 00000100:00100000:3.0:1789683453.541467:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+19:10497:x1876618835419904:12345-192.168.201.50@tcp:36:rm.0 00010000:00010000:3.0:1789683453.541538:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789683453.541578:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b889882 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc505 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.541598:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88982e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4e9 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.541609:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f0f83e0b400) 00010000:00010000:3.0:1789683453.541619:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b889843 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4f0 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.541627:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0e835ac000) 00010000:00010000:3.0:1789683453.541630:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683453.541648:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676200/0xcf8485587b889889 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.541660:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676200/0xcf8485587b889889 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.541669:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676200/0xcf8485587b889889 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.541679:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b889890 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.541686:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b889890 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.541692:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b889890 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.541840:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176000/0xcf8485587b889897 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.541849:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176000/0xcf8485587b889897 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.541856:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176000/0xcf8485587b889897 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789683453.542089:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789683453.542099:0:8462:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 367591314823ns, next at 368591311835ns, rc = 0 00010000:00010000:3.0:1789683453.542146:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88989e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542154:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88989e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542161:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88989e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542169:0:8462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88989e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542175:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88989e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542180:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88989e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542196:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683453.542215:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176000/0xcf8485587b889897 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542227:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176000/0xcf8485587b889897 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542234:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176000/0xcf8485587b889897 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542240:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683453.542244:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176000/0xcf8485587b889897 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542252:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176000/0xcf8485587b889897 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542272:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f0f83e0b400) 00010000:00010000:3.0:1789683453.542275:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789683453.542280:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176000/0xcf8485587b889897 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542285:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176000/0xcf8485587b889897 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542302:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676200/0xcf8485587b889889 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542307:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676200/0xcf8485587b889889 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542313:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676200/0xcf8485587b889889 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542317:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81676200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683453.542326:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676200/0xcf8485587b889889 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542333:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676200/0xcf8485587b889889 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542340:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0e835ac000) 00010000:00010000:3.0:1789683453.542342:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683453.542345:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676200/0xcf8485587b889889 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542351:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676200/0xcf8485587b889889 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683453.542363:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8c5b203 reply state 000000000949af26 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b889890 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542374:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b889890 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683453.542380:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff9f0e835ac900) 00010000:00010000:3.0:1789683453.542382:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789683453.542385:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789683453.542461:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+18:10497:x1876618835419904:12345-192.168.201.50@tcp:36:rm.0 Request processed in 995us (1313us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789683453.542468:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 38 00010000:00010000:0.0:1789683453.542821:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683453.542828:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88989e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.542836:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683453.542839:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88989e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.542854:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88989e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.542863:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f0f83e0b400) 00010000:00010000:0.0:1789683453.542865:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789683453.542868:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88989e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.542874:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88989e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.542885:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683453.542886:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683453.542888:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683453.546522:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850183808:0@lo:400:kworker.0 00000100:00100000:1.0:1789683453.546609:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683453.547634:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850183936:0@lo:400:kworker.0 00000100:00100000:0.0:1789683453.547681:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683453.548992:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850183808 00000100:00100000:1.0:1789683453.549004:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850183808 00000100:00100000:1.0:1789683453.549052:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789683453.549063:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3649:x1876618850183808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683453.549138:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3649:x1876618850183808:12345-0@lo:400:kworker.0 Request processed in 77us (2528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683453.549145:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789683453.549184:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850183936 00000100:00100000:1.0:1789683453.549188:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850183936 00000100:00100000:1.0:1789683453.549217:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789683453.549224:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850183936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683453.549272:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850183936:12345-0@lo:400:kworker.0 Request processed in 49us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683453.549279:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789683453.549313:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850183808:0@lo:400:kworker.0 00000100:00100000:0.0:1789683453.549662:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850183936:0@lo:400:kworker.0 00000100:00100000:0.0:1789683453.549777:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683453.549814:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850184320:0@lo:400:kworker.0 00000100:00100000:0.0:1789683453.549850:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683453.549894:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850184448:0@lo:400:kworker.0 00000100:00100000:0.0:1789683453.549918:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683453.549964:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683453.549970:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850184832:0@lo:400:kworker.0 00000100:00100000:0.0:1789683453.550005:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683453.550032:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850184832 00000100:00100000:0.0:1789683453.550036:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850184832 00000100:00100000:0.0:1789683453.550083:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789683453.550091:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850184832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683453.550128:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850184832:12345-0@lo:400:kworker.0 Request processed in 40us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683453.550134:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789683453.550153:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789683453.550174:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb6172a00 x1876618850184832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683453.550184:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850184832:0@lo:400:kworker.0 00000100:00100000:0.0:1789683453.550214:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850184960:0@lo:400:kworker.0 00000100:00100000:0.0:1789683453.550236:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683453.550371:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850184192:0@lo:400:kworker.0 00000100:00100000:2.0:1789683453.550402:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683453.550422:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850184704:0@lo:400:kworker.0 00000100:00100000:2.0:1789683453.550648:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683453.550671:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789683453.550678:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850184064:0@lo:400:kworker.0 00000100:00100000:2.0:1789683453.550702:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683453.550717:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850184576:0@lo:400:kworker.0 00000100:00100000:2.0:1789683453.550738:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683453.550766:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850184448 00000100:00100000:2.0:1789683453.550771:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850184448 00000100:00100000:1.0:1789683453.550848:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850184320 00000100:00100000:1.0:1789683453.550853:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850184320 00000100:00100000:1.0:1789683453.550883:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850184064 00000100:00100000:1.0:1789683453.550886:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850184064 00000100:00100000:1.0:1789683453.550901:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789683453.550907:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850184320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683453.551042:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789683453.551051:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850184064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683453.551088:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850184064:12345-0@lo:400:kworker.0 Request processed in 39us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683453.551094:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789683453.551158:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683453.551177:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850184960 00000100:00100000:3.0:1789683453.551180:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850184960 00000100:00100000:2.0:1789683453.551268:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850184192 00000100:00100000:2.0:1789683453.551272:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850184192 00000100:00100000:2.0:1789683453.551285:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850184576 00000100:00100000:2.0:1789683453.551288:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850184576 00000100:00100000:1.0:1789683453.551322:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850184320:12345-0@lo:400:kworker.0 Request processed in 415us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683453.551328:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789683453.551355:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850184704 00000100:00100000:1.0:1789683453.551358:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850184704 00000100:00100000:3.0:1789683453.551395:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789683453.551402:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850184448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683453.551430:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850184448:12345-0@lo:400:kworker.0 Request processed in 29us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683453.551458:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789683453.551472:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789683453.551478:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850184192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683453.551503:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850184192:12345-0@lo:400:kworker.0 Request processed in 26us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683453.551507:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789683453.551517:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789683453.551523:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850184960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683453.551556:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850184960:12345-0@lo:400:kworker.0 Request processed in 34us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683453.551562:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789683453.552194:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850184064:0@lo:400:kworker.0 00000100:00100000:3.0:1789683453.552208:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850184192:0@lo:400:kworker.0 00000100:00080000:0.0:1789683453.552352:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683453.552357:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683453.552359:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683453.552429:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683453.552755:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789683453.552765:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850184576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683453.552902:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789683453.552910:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850184704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683453.553042:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850185088:0@lo:400:kworker.0 00000100:00100000:3.0:1789683453.553078:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683453.553157:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850184576:12345-0@lo:400:kworker.0 Request processed in 394us (2418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683453.553164:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789683453.553180:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850185088 00000100:00100000:2.0:1789683453.553184:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850185088 00000100:00100000:1.0:1789683453.553237:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850184704:12345-0@lo:400:kworker.0 Request processed in 327us (2588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683453.553244:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:3.0:1789683453.553357:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb6170700 x1876618850184576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683453.553386:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850184576:0@lo:400:kworker.0 00010000:00080000:3.0:1789683453.553402:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb6172680 x1876618850184704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683453.553411:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850184704:0@lo:400:kworker.0 00000100:00100000:0.0:1789683453.553508:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00080000:0.0:1789683453.553518:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789683453.553528:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876618850185088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683453.553580:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876618850185088:12345-0@lo:400:kworker.0 Request processed in 65us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683453.553587:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00010000:00080000:3.0:1789683453.553705:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb6170380 x1876618850185088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683453.553715:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850185088:0@lo:400:kworker.0 00000100:00100000:2.0:1789683453.553835:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835420160 00000100:00100000:2.0:1789683453.553840:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835420160 00000100:00100000:2.0:1789683453.553876:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:2.0:1789683453.553883:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+18:10497:x1876618835420160:12345-192.168.201.50@tcp:35:rm.0 00000100:00100000:2.0:1789683453.554096:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+19:10497:x1876618835420160:12345-192.168.201.50@tcp:35:rm.0 Request processed in 210us (2935us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789683453.554102:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:1.0:1789683453.556304:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850184960:0@lo:400:kworker.0 00000100:00100000:1.0:1789683453.556324:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850184448:0@lo:400:kworker.0 00000100:00100000:1.0:1789683453.556336:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850184320:0@lo:400:kworker.0 00000100:00100000:1.0:1789683453.557115:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683453.557201:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835420416 00000100:00100000:0.0:1789683453.557210:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835420416 00000100:00100000:0.0:1789683453.557368:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 39 00000100:00100000:0.0:1789683453.557380:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+19:10497:x1876618835420416:12345-192.168.201.50@tcp:36:rm.0 00010000:00010000:0.0:1789683453.557566:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789683453.557595:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677a00/0xcf8485587b88985f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4fe expref: 19 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.557635:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b8897fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4db expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.557647:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0e835ac000) 00010000:00010000:0.0:1789683453.557662:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b8897be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4cd expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.557672:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fc11eb300) 00010000:00010000:0.0:1789683453.557679:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789683453.557702:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8898a5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.557714:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8898a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.557725:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8898a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.557737:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8898ac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.557745:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8898ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.557751:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8898ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.557870:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b8898b3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.557889:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b8898b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.557897:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b8898b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683453.558129:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789683453.558145:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b8898b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.558152:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b8898b3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.558160:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b8898b3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.558165:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683453.558169:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b8898b3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.558176:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b8898b3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.558185:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0e835acb00) 00010000:00010000:0.0:1789683453.558188:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789683453.558192:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b8898b3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.558198:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b8898b3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.558215:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8898a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.558228:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8898a5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.558233:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8898a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.558238:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454ce00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683453.558242:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8898a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.558248:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8898a5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.558256:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e835acf00) 00010000:00010000:0.0:1789683453.558403:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683453.558408:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8898a5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.558414:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b8898a5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789683453.558427:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2775387 reply state 00000000c64d89ad transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8898ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.558568:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8898ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683453.558575:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f0e835ac400) 00010000:00010000:0.0:1789683453.558578:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789683453.558581:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789683453.558700:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+18:10497:x1876618835420416:12345-192.168.201.50@tcp:36:rm.0 Request processed in 1321us (1587us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789683453.558717:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 39 00010000:00010000:0.0:1789683453.983645:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683455.026945:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683455.512710:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683455.512762:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683455.512817:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683455.512838:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683455.512862:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683455.512884:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683455.513031:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835420800 00000100:00100000:1.0:1789683455.513041:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835420800 00000100:00100000:1.0:1789683455.513103:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835421056 00000100:00100000:1.0:1789683455.513107:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835421056 00000100:00100000:1.0:1789683455.513122:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835420672 00000100:00100000:1.0:1789683455.513125:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835420672 00000100:00100000:1.0:1789683455.513136:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835421184 00000100:00100000:1.0:1789683455.513138:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835421184 00000100:00100000:1.0:1789683455.513153:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 215 00000100:00100000:1.0:1789683455.513163:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835420800:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683455.513258:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835420800:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 95us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683455.513266:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 215 00000100:00100000:1.0:1789683455.513285:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 216 00000100:00100000:1.0:1789683455.513291:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835421056:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683455.513323:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835421056:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 33us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683455.513328:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 216 00000100:00100000:1.0:1789683455.513339:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 217 00000100:00100000:1.0:1789683455.513344:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+18:2403:x1876618835420672:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683455.513371:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+18:2403:x1876618835420672:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 26us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683455.513377:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 217 00000100:00100000:1.0:1789683455.513388:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 218 00000100:00100000:1.0:1789683455.513394:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835421184:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683455.513417:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835421184:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 24us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683455.513423:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 218 00000100:00080000:1.0:1789683455.513439:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683455.513442:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683455.518773:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835420928 00000100:00100000:3.0:1789683455.525975:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835420928 00000100:00100000:3.0:1789683455.526132:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 85 00000100:00100000:3.0:1789683455.526143:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835420928:12345-192.168.201.50@tcp:400:kworker.0 00000100:00080000:1.0:1789683455.526332:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683455.526754:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835420928:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 612us (13889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683455.526763:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 85 00000100:00100000:0.0:1789683455.530464:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835420544 00000100:00100000:0.0:1789683455.530478:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835420544 00000100:00100000:1.0:1789683455.538137:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 341 00000100:00100000:1.0:1789683455.538152:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:2403:x1876618835420544:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683455.538261:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:2403:x1876618835420544:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 111us (25561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683455.538269:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 341 00000100:00100000:3.0:1789683455.584312:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850185216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683455.584392:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683455.584479:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850185216 00000100:00100000:3.0:1789683455.584488:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850185216 00000100:00100000:3.0:1789683455.584551:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789683455.584561:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850185216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789683455.584593:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789683455.584636:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850185216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683455.584659:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789683455.584705:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850185216:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789683456.034358:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683456.098542:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850185344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683456.098621:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683456.099197:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850185344 00000100:00100000:3.0:1789683456.099206:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850185344 00000100:00100000:3.0:1789683456.099279:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789683456.099289:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850185344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789683456.099319:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683456.099378:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850185344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683456.099384:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1789683456.099457:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789683456.099496:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0725880 x1876618850185344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683456.099517:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850185344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683456.607746:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683456.607771:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850185472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683456.607871:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683456.607985:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850185472 00000100:00100000:2.0:1789683456.607994:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850185472 00000100:00100000:2.0:1789683456.608060:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789683456.608071:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850185472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683456.608110:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789683456.608175:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850185472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683456.608183:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789683456.608249:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850185472:0@lo:41:osp-pre-0-1.0 00000004:00080000:3.0:1789683456.608429:0:8675:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 370657644294ns, next at 371657641535ns, rc = 0 00000100:00100000:0.0:1789683456.608504:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683456.608515:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850185600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683456.608550:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683456.608679:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850185600 00000100:00100000:2.0:1789683456.608685:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850185600 00000100:00100000:2.0:1789683456.608734:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789683456.608741:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850185600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789683456.608775:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683456.608843:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850185600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683456.608849:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1789683456.608908:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789683456.609407:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0724e00 x1876618850185600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683456.609432:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850185600:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789683457.055775:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789683458.070318:0:13689:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1789683458.080295:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683458.146448:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850185728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683458.146520:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683458.146634:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850185728 00000100:00100000:0.0:1789683458.146642:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850185728 00000100:00100000:0.0:1789683458.146704:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789683458.146713:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850185728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789683458.146742:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683458.146827:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850185728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683458.146834:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1789683458.146932:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789683458.146959:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0725f80 x1876618850185728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683458.146977:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850185728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683458.655701:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850185856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683458.655774:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683458.658162:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850185984:0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.658242:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683458.658291:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850186496:0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.658319:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683458.658339:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850187008:0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.658374:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683458.658402:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789683458.658408:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850186368:0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.658431:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683458.658448:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850186880:0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.658465:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683458.658480:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850187392:0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.658500:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683458.658525:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850186112:0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.658577:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683458.658596:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1876618850186624:0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.658625:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683458.658645:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850187136:0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.658668:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683458.658683:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789683458.658696:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850186240:0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.658716:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683458.658730:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850186752:0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.658747:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683458.658771:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1876618850187264:0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.658809:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683458.658836:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850186496 00000100:00100000:2.0:1789683458.658843:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850186496 00000100:00100000:2.0:1789683458.658891:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850186240 00000100:00100000:2.0:1789683458.658895:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850186240 00000100:00100000:2.0:1789683458.658912:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789683458.658920:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850186496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.658975:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850186496:12345-0@lo:400:kworker.0 Request processed in 56us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683458.658981:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789683458.658999:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789683458.659004:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850186240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.659033:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850186240:12345-0@lo:400:kworker.0 Request processed in 30us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683458.659038:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789683458.659055:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850186368 00000100:00100000:2.0:1789683458.659059:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850186368 00000100:00100000:2.0:1789683458.659076:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850186112 00000100:00100000:2.0:1789683458.659078:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850186112 00000100:00100000:2.0:1789683458.659089:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850186624 00000100:00100000:2.0:1789683458.659091:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850186624 00000100:00100000:2.0:1789683458.659112:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850187136 00000100:00100000:2.0:1789683458.659116:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850187136 00000100:00100000:2.0:1789683458.659136:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850186752 00000100:00100000:2.0:1789683458.659138:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850186752 00000100:00100000:2.0:1789683458.659149:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850187264 00000100:00100000:2.0:1789683458.659151:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850187264 00000100:00100000:2.0:1789683458.659163:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789683458.659168:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850186368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.659197:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850186368:12345-0@lo:400:kworker.0 Request processed in 28us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683458.659202:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789683458.659213:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789683458.659219:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850186112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.659244:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850186112:12345-0@lo:400:kworker.0 Request processed in 26us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683458.659249:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789683458.659262:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789683458.659268:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876618850186624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.659293:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876618850186624:12345-0@lo:400:kworker.0 Request processed in 26us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683458.659298:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789683458.659309:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789683458.659315:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850187136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.659339:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850187136:12345-0@lo:400:kworker.0 Request processed in 25us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683458.659345:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789683458.659356:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789683458.659361:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850186752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.659396:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850186752:12345-0@lo:400:kworker.0 Request processed in 35us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683458.659402:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789683458.659414:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789683458.659419:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876618850187264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.659444:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876618850187264:12345-0@lo:400:kworker.0 Request processed in 25us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683458.659449:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:2.0:1789683458.659483:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789683458.659487:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683458.659495:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850187008 00000100:00100000:3.0:1789683458.659499:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850187008 00000100:00100000:2.0:1789683458.659513:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850186240:0@lo:400:kworker.0 00010000:00080000:2.0:1789683458.659526:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83f18a80 x1876618850186752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683458.659529:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850186880 00000100:00100000:3.0:1789683458.659531:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850186880 00000100:00100000:2.0:1789683458.659537:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850186752:0@lo:400:kworker.0 00000100:00100000:3.0:1789683458.659543:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850187392 00000100:00100000:3.0:1789683458.659545:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850187392 00010000:00080000:2.0:1789683458.659547:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83f18700 x1876618850187264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683458.659555:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1876618850187264:0@lo:400:kworker.0 00000100:00100000:3.0:1789683458.659558:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789683458.659563:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850187008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.659564:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850186112:0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.659572:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1876618850186624:0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.659580:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850187136:0@lo:400:kworker.0 00000100:00100000:3.0:1789683458.659596:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850187008:12345-0@lo:400:kworker.0 Request processed in 34us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683458.659602:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789683458.659613:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1789683458.659614:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683458.659616:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683458.659619:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850186880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.659630:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850186368:0@lo:400:kworker.0 00000100:00100000:3.0:1789683458.659642:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850186880:12345-0@lo:400:kworker.0 Request processed in 25us (1177us total) trans 0 rc 0/0 00010000:00080000:2.0:1789683458.659648:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83f19c00 x1876618850186880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683458.659653:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789683458.659657:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850186880:0@lo:400:kworker.0 00000100:00100000:3.0:1789683458.659663:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789683458.659667:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850186496:0@lo:400:kworker.0 00000100:00100000:3.0:1789683458.659668:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850187392:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789683458.659674:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83f1b800 x1876618850187008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683458.659682:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850187008:0@lo:400:kworker.0 00000100:00100000:3.0:1789683458.659693:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850187392:12345-0@lo:400:kworker.0 Request processed in 25us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683458.659698:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1789683458.659700:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83f1a680 x1876618850187392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683458.659708:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850187392:0@lo:400:kworker.0 00000100:00100000:3.0:1789683458.659749:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850185984 00000100:00100000:3.0:1789683458.659753:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850185984 00000100:00100000:2.0:1789683458.661865:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850185856 00000100:00100000:2.0:1789683458.661878:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850185856 00000100:00100000:2.0:1789683458.661939:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789683458.661947:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850185856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683458.661971:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683458.662030:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850185856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (6255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683458.662037:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1789683458.662176:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7961c00 x1876618850185856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683458.662194:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850185856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683458.664384:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1789683458.664405:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3650:x1876618850185984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683458.664505:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3650:x1876618850185984:12345-0@lo:400:kworker.0 Request processed in 108us (6261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683458.664513:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789683458.664563:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850185984:0@lo:400:kworker.0 00010000:00010000:1.0:1789683459.105974:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789683459.197114:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1789683459.197164:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1789683459.197184:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1789683459.197604:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889812 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197619:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889812 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197628:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889812 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197635:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454ca00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683459.197640:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889812 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197649:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889812 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197668:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff9f0e835ac900) 00010000:00010000:2.0:1789683459.197672:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683459.197677:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889812 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197684:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889812 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197707:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b889827 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197713:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b889827 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197719:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b889827 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197736:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683459.197740:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b889827 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197745:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b889827 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197754:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f0f83e0b400) 00010000:00010000:2.0:1789683459.197756:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683459.197759:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b889827 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197764:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b889827 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197806:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b889890 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197813:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b889890 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197820:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b889890 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197825:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81676c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683459.197828:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b889890 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197835:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b889890 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197853:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff9f0e835ac900) 00010000:00010000:2.0:1789683459.197856:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683459.197859:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b889890 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197865:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676c00/0xcf8485587b889890 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197894:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8898ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197901:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8898ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197908:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8898ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197914:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454de00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683459.197917:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8898ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197922:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8898ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197929:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f0e835ac400) 00010000:00010000:2.0:1789683459.197931:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683459.197934:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8898ac lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.197939:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b8898ac lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683459.198047:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683459.198066:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850187520:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789683459.198136:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683459.198309:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850187520 00000100:00100000:1.0:1789683459.198318:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850187520 00000100:00100000:1.0:1789683459.198389:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789683459.198399:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850187520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789683459.198427:0:8676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1789683459.198460:0:8676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aac66fd, atime: 0x6aac66fd, ctime: 0x6aac66fd, blocks: 0x0 00010000:00010000:1.0:1789683459.198467:0:8676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3407af/0xcf8485587b8898ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.198494:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=373s v=(0 0) 00010000:00010000:1.0:1789683459.198499:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683459.198506:0:8676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b3407af/0xcf8485587b8898ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.198523:0:8676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b3407af/0xcf8485587b8898ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.198532:0:8676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3407af/0xcf8485587b8898ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.198538:0:8676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b3407af/0xcf8485587b8898ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.198554:0:8676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789683459.198706:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1876618850187520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 308us (569us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789683459.198715:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1789683459.200121:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683459.200135:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b3407af/0xcf8485587b8898ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.200149:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dac00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683459.200155:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3407af/0xcf8485587b8898ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.200167:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3407af/0xcf8485587b8898ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.200195:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b3407af/0xcf8485587b8898ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.200203:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b3407af/0xcf8485587b8898ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.200227:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683459.200229:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683459.200231:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789683459.200287:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0fb7961c00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1789683459.200297:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850187520:0@lo:6:osp-syn-0-0.0 00000020:00000080:2.0:1789683459.521918:0:13737:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0f917740 20000000:00000080:2.0:1789683459.521939:0:13737:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0e83c86000 uarg=0000000000000000 20000000:01000000:2.0:1789683459.521984:0:13737:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789683459.521990:0:13737:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789683459.521996:0:13737:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789683459.527988:0:13738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789683459.528180:0:13737:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789683459.533383:0:13737:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1789683459.533424:0:13737:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1789683459.533445:0:13737:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1789683459.533464:0:13737:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789683459.533486:0:13737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0e837da200/0xcf8485587b8898c1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.533505:0:13737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f81677e00/0xcf8485587b889747 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4b8 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.533527:0:13737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0e837da800/0xcf8485587b88974e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4bf expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.533536:0:13737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b88975c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889755 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.533543:0:13737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0e837db600/0xcf8485587b88976a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889763 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.533549:0:13737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f8454c000/0xcf8485587b889778 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889771 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.533555:0:13737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f81677200/0xcf8485587b889786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88977f expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.533561:0:13737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0e837da200/0xcf8485587b8898c1 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.533601:0:13737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f81677200/0xcf8485587b889786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88977f expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.533615:0:13737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f81677200/0xcf8485587b889786 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88977f expref: 23 pid: 6515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683459.533630:0:13737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7963100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1876618850187648:0@lo:104: 00000100:00100000:1.0:1789683459.533696:0:13737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683459.533863:0:13737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f8454c000/0xcf8485587b889778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b889771 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.533892:0:13737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0f8454c000/0xcf8485587b889778 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b889771 expref: 23 pid: 6515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683459.533900:0:13737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1876618850187776:0@lo:104: 00010000:00010000:1.0:1789683459.533929:0:13737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0e837db600/0xcf8485587b88976a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b889763 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.533936:0:13737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0e837db600/0xcf8485587b88976a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b889763 expref: 23 pid: 6515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683459.533943:0:13737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7963b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1876618850187904:0@lo:104: 00010000:00010000:1.0:1789683459.533966:0:13737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b88975c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b889755 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.533973:0:13737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b88975c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b889755 expref: 23 pid: 6514 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683459.533979:0:13737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1876618850188032:0@lo:104: 00010000:00010000:1.0:1789683459.534003:0:13737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0e837da800/0xcf8485587b88974e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4bf expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.534013:0:13737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0e837da800/0xcf8485587b88974e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4bf expref: 12 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683459.534022:0:13737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1876618850188160:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789683459.534077:0:13737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f81677e00/0xcf8485587b889747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4b8 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.534095:0:13737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0f81677e00/0xcf8485587b889747 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4b8 expref: 12 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683459.534103:0:13737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1876618850188288:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789683459.534129:0:13737:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789683459.537597:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789683459.537649:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683459.537730:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683459.537812:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683459.537921:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850187648 00000100:00100000:3.0:1789683459.537932:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850187648 00000100:00100000:3.0:1789683459.537976:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850187776 00000100:00100000:3.0:1789683459.537978:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850187776 00000100:00100000:3.0:1789683459.537987:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850187904 00000100:00100000:3.0:1789683459.537989:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850187904 00000100:00100000:3.0:1789683459.538000:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789683459.538009:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83585450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:13737:x1876618850187648:12345-0@lo:104: 00010000:00010000:3.0:1789683459.538027:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88977f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889786 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683459.538188:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789683459.538195:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83585450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+5:13737:x1876618850187648:12345-0@lo:104: Request processed in 187us (4499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683459.538203:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789683459.538246:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789683459.538268:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:13737:x1876618850187776:12345-0@lo:104: 00010000:00010000:3.0:1789683459.538276:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b889771 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889778 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683459.538601:0:13737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7963100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1876618850187648:0@lo:104: 00000100:00100000:2.0:1789683459.538611:0:13737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1876618850187776:0@lo:104: 00000100:00100000:1.0:1789683459.538737:0:6504:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789683459.538746:0:6504:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1789683459.539009:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683459.539025:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88977f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889786 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.539034:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8000 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683459.539038:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88977f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b889786 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.539046:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88977f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b889786 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683459.539053:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88977f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b889786 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683459.539059:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789683459.539159:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789683459.539168:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:13737:x1876618850187776:12345-0@lo:104: Request processed in 899us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683459.539175:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789683459.539191:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850188032 00000100:00100000:3.0:1789683459.539197:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850188032 00000100:00100000:3.0:1789683459.539214:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789683459.539219:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:13737:x1876618850187904:12345-0@lo:104: 00010000:00010000:3.0:1789683459.539228:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c600/0xcf8485587b889763 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88976a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683459.539283:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789683459.539288:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+4:13737:x1876618850187904:12345-0@lo:104: Request processed in 69us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683459.539294:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789683459.539306:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789683459.539312:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:13737:x1876618850188032:12345-0@lo:104: 00010000:00010000:3.0:1789683459.539319:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f8454d400/0xcf8485587b889755 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88975c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.539416:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683459.539422:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b889771 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b889778 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.539429:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9600 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683459.539432:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b889771 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b889778 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.539438:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b889771 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b889778 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683459.539444:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b889771 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b889778 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683459.539449:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789683459.539494:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789683459.539500:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+3:13737:x1876618850188032:12345-0@lo:104: Request processed in 189us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683459.539505:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1789683459.539523:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683459.539528:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c600/0xcf8485587b889763 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88976a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683459.539541:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454c600 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683459.539544:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c600/0xcf8485587b889763 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88976a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683459.539551:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c600/0xcf8485587b889763 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88976a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683459.539557:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c600/0xcf8485587b889763 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88976a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683459.539562:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789683459.542759:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b889771 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889778 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.542777:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683459.542830:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b889771 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889778 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.542852:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9600/0xcf8485587b889771 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889778 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.542878:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683459.542882:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f8454d400/0xcf8485587b889755 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88975c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.542889:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d400 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683459.542894:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f8454d400/0xcf8485587b889755 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88975c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.542903:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f8454d400/0xcf8485587b889755 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88975c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683459.542911:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f8454d400/0xcf8485587b889755 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88975c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683459.542916:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789683459.542932:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f8454d400/0xcf8485587b889755 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88975c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.542938:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683459.542944:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f8454d400/0xcf8485587b889755 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88975c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.542951:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f8454d400/0xcf8485587b889755 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88975c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.542961:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683459.542968:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683459.542970:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683459.542990:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850188544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683459.543057:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683459.543111:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683459.543118:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850188416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683459.543140:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683459.543243:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850188544 00000100:00100000:2.0:1789683459.543319:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850188544 00010000:00010000:1.0:1789683459.543442:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88977f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889786 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.543460:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683459.543476:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88977f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889786 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.543482:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88977f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b889786 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.543492:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683459.543494:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683459.543496:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683459.543603:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b88975c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889755 expref: 24 pid: 6514 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683459.543637:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850188416 00000100:00100000:2.0:1789683459.543641:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850188416 00010000:00010000:2.0:1789683459.543651:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f8454c000/0xcf8485587b889778 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889771 expref: 25 pid: 6515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683459.543670:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789683459.543678:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e97b3c51-c653-4f2f-8e95-54cfcf70f127+25:3648:x1876618850188544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683459.543690:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683459.543694:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b88975c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889755 expref: 25 pid: 6514 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.543702:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b88975c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b889755 expref: 25 pid: 6514 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.543718:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683459.543755:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e97b3c51-c653-4f2f-8e95-54cfcf70f127+25:3648:x1876618850188544:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683459.543761:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789683459.543811:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789683459.543818:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850188416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683459.543826:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683459.543830:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f8454c000/0xcf8485587b889778 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889771 expref: 24 pid: 6515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.543838:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f8454c000/0xcf8485587b889778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b889771 expref: 24 pid: 6515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.543848:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f8454c000/0xcf8485587b889778 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b889771 expref: 24 pid: 6515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.543856:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683459.543889:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:3648:x1876618850188416:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683459.543895:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789683459.543928:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850188416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683459.543936:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850188544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683459.543970:0:13737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7963b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1876618850187904:0@lo:104: 00010000:00010000:2.0:1789683459.543979:0:13737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f8600/0xcf8485587b88975c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b889755 expref: 22 pid: 6514 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683459.543988:0:13737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1876618850188032:0@lo:104: 00000100:00100000:0.0:1789683459.544067:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850188672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683459.544098:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683459.544202:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850188672 00000100:00100000:1.0:1789683459.544207:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850188672 00010000:00010000:1.0:1789683459.544225:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f81677200/0xcf8485587b889786 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88977f expref: 22 pid: 6515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683459.544239:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789683459.544261:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:3649:x1876618850188672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683459.544269:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683459.544274:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f81677200/0xcf8485587b889786 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88977f expref: 22 pid: 6515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.544284:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f81677200/0xcf8485587b889786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88977f expref: 22 pid: 6515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.544294:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81677200/0xcf8485587b889786 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88977f expref: 22 pid: 6515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683459.544303:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683459.544761:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:3649:x1876618850188672:12345-0@lo:103:ldlm_bl.0 Request processed in 508us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683459.544768:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789683459.544820:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850188672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683459.545015:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683459.545835:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c600/0xcf8485587b889763 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88976a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683459.545845:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683459.545877:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c600/0xcf8485587b889763 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88976a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683459.545884:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c600/0xcf8485587b889763 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88976a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683459.545904:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683459.545918:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850188800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683459.545965:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789683459.546007:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683459.546009:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683459.546011:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683459.548387:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850188800 00000100:00100000:2.0:1789683459.548404:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850188800 00010000:00010000:2.0:1789683459.548452:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0e837db600/0xcf8485587b88976a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889763 expref: 21 pid: 6515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683459.548519:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789683459.548528:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0727b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:3649:x1876618850188800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683459.548549:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683459.548555:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0e837db600/0xcf8485587b88976a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b889763 expref: 21 pid: 6515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.548568:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0e837db600/0xcf8485587b88976a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b889763 expref: 21 pid: 6515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.548584:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837db600/0xcf8485587b88976a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b889763 expref: 21 pid: 6515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683459.548599:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683459.548669:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0727b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:3649:x1876618850188800:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (2702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683459.548676:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789683459.548902:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850188800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683459.550640:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683459.550677:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683459.555558:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835421312 00000100:00100000:0.0:1789683459.555575:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835421312 00010000:00010000:0.0:1789683459.555628:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0e837da800/0xcf8485587b88974e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4bf expref: 13 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683459.555668:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835421440 00000100:00100000:0.0:1789683459.555673:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835421440 00010000:00010000:0.0:1789683459.555686:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f81677e00/0xcf8485587b889747 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4b8 expref: 14 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683459.555704:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:0.0:1789683459.555715:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea7031b9-febc-4826-a965-62f420153ef7+14:2403:x1876618835421312:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683459.555748:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683459.555754:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0e837da800/0xcf8485587b88974e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4bf expref: 14 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.555765:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0e837da800/0xcf8485587b88974e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4bf expref: 14 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.555800:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683459.555860:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea7031b9-febc-4826-a965-62f420153ef7+14:2403:x1876618835421312:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 148us (5228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683459.555877:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:0.0:1789683459.555897:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 51 00000100:00100000:0.0:1789683459.555904:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea7031b9-febc-4826-a965-62f420153ef7+13:2403:x1876618835421440:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683459.555911:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683459.555915:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f81677e00/0xcf8485587b889747 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4b8 expref: 13 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.555923:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f81677e00/0xcf8485587b889747 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4b8 expref: 13 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.555935:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0e837da200/0xcf8485587b8898c1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.555943:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837da200/0xcf8485587b8898c1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.555959:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0e837da200/0xcf8485587b8898c1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.555978:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0e837da200/0xcf8485587b8898c1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.555984:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0e837da200/0xcf8485587b8898c1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.555991:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0e837da200/0xcf8485587b8898c1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.555997:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837da200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683459.556002:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0e837da200/0xcf8485587b8898c1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.556010:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0e837da200/0xcf8485587b8898c1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.556019:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0e837da200/0xcf8485587b8898c1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.556027:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683459.556049:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea7031b9-febc-4826-a965-62f420153ef7+13:2403:x1876618835421440:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 145us (5371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683459.556055:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 51 00010000:00010000:2.0:1789683459.561019:0:13737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837da800/0xcf8485587b88974e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4bf expref: 12 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683459.561039:0:13737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1876618850188160:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683459.573158:0:13737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81677e00/0xcf8485587b889747 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc4b8 expref: 11 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683459.573183:0:13737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1876618850188288:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683459.573228:0:13737:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0e837da200/0xcf8485587b8898c1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.573260:0:13737:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0e837da200/0xcf8485587b8898c1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.573267:0:13737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0e837da200/0xcf8485587b8898c1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683459.573274:0:13737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837da200/0xcf8485587b8898c1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683460.134087:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789683460.391705:0:13787:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6fe71220 20000000:00000080:0.0:1789683460.391722:0:13787:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0e836cac00 uarg=0000000000000000 20000000:01000000:0.0:1789683460.391764:0:13787:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1789683460.391769:0:13787:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1789683460.391773:0:13787:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1789683460.392356:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1789683460.392628:0:13787:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1789683460.392699:0:13787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1789683460.392722:0:13787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1789683460.392730:0:13787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1789683460.392740:0:13787:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789683460.392758:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0fb7a31800/0xcf8485587b8898c8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683460.392779:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb7a31800/0xcf8485587b8898c8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683460.392823:0:13787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0fb7a31800/0xcf8485587b8898c8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683460.392831:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0fb7a31800/0xcf8485587b8898c8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683460.392838:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0fb7a31800/0xcf8485587b8898c8 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683460.392846:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0fb7a31800/0xcf8485587b8898c8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683460.392883:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683460.392887:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0fb7a31800/0xcf8485587b8898c8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683460.392896:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0fb7a31800/0xcf8485587b8898c8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683460.392909:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0fb7a31800/0xcf8485587b8898c8 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683460.392915:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0fb7a31800/0xcf8485587b8898c8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683460.392919:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb7a31800/0xcf8485587b8898c8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683460.630528:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683460.630574:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683460.630617:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683460.630648:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683460.630670:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683460.630747:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683460.630775:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835421952 00000100:00100000:0.0:1789683460.630815:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835421952 00000100:00100000:0.0:1789683460.630904:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 89 00000100:00100000:0.0:1789683460.630916:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835421952:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683460.630988:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835421952:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 75us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683460.631012:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 89 00000100:00100000:3.0:1789683460.631892:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835421824 00000100:00100000:3.0:1789683460.631901:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835421824 00000100:00100000:3.0:1789683460.631963:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835422080 00000100:00100000:3.0:1789683460.631967:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835422080 00000100:00100000:3.0:1789683460.631981:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835421696 00000100:00100000:3.0:1789683460.631984:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835421696 00000100:00100000:3.0:1789683460.631999:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835422208 00000100:00100000:3.0:1789683460.632002:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835422208 00000100:00100000:3.0:1789683460.632019:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 225 00000100:00100000:3.0:1789683460.632027:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835421824:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683460.632076:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835421824:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 50us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683460.632084:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 225 00000100:00100000:3.0:1789683460.632099:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 226 00000100:00100000:3.0:1789683460.632105:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835422080:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683460.632139:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835422080:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 24us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683460.632147:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 226 00000100:00100000:3.0:1789683460.632160:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 227 00000100:00100000:3.0:1789683460.632166:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835421696:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683460.632190:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835421696:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 24us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683460.632195:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 227 00000100:00100000:3.0:1789683460.632207:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 228 00000100:00100000:3.0:1789683460.632212:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835422208:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683460.632234:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835422208:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 22us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683460.632250:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 228 00000100:00100000:1.0:1789683460.632365:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835421568 00000100:00100000:1.0:1789683460.632370:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835421568 00000100:00100000:1.0:1789683460.632405:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 343 00000100:00100000:1.0:1789683460.632412:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+11:2403:x1876618835421568:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683460.632447:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+11:2403:x1876618835421568:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 36us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683460.632453:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 343 00000100:00080000:2.0:1789683460.632916:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683460.632922:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789683460.632924:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683460.704975:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850188928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683460.705055:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683460.705269:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850188928 00000100:00100000:3.0:1789683460.705278:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850188928 00000100:00100000:3.0:1789683460.705596:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789683460.705605:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850188928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789683460.705640:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789683460.705698:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850188928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683460.705705:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789683460.705933:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850188928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683460.884733:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683460.884873:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835422336 00000100:00100000:1.0:1789683460.884898:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835422336 00000100:00100000:1.0:1789683460.884963:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 344 00000100:00100000:1.0:1789683460.884974:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+11:6175:x1876618835422336:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683460.884992:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683460.885011:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837dba00/0xcf8485587b8898cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc50c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683460.885040:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837dba00/0xcf8485587b8898cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc50c expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683460.885052:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837dba00/0xcf8485587b8898cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc50c expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683460.885060:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dba00, rc 0) 00000100:00100000:1.0:1789683460.885124:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+12:6175:x1876618835422336:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 Request processed in 151us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683460.885131:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 344 00000100:00100000:1.0:1789683460.905627:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683460.905727:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835422464 00000100:00100000:3.0:1789683460.905737:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835422464 00000100:00100000:3.0:1789683460.905817:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 345 00000100:00100000:3.0:1789683460.905827:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+12:6175:x1876618835422464:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683460.906021:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+12:6175:x1876618835422464:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 Request processed in 194us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683460.906029:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 345 00000100:00100000:0.0:1789683460.923957:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683460.924056:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835422592 00000100:00100000:3.0:1789683460.924067:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835422592 00000100:00100000:3.0:1789683460.924134:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 346 00000100:00100000:3.0:1789683460.924145:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+12:6175:x1876618835422592:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683460.925668:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+12:6175:x1876618835422592:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 Request processed in 1512us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683460.925681:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 346 00000100:00100000:0.0:1789683460.937034:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683460.937136:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835422720 00000100:00100000:1.0:1789683460.937155:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835422720 00000100:00100000:1.0:1789683460.937215:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 347 00000100:00100000:1.0:1789683460.937226:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+12:10781:x1876618835422720:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789683460.937697:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+12:10781:x1876618835422720:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 471us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683460.937706:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 347 00000100:00100000:1.0:1789683460.953499:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683460.953678:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835422848 00000100:00100000:2.0:1789683460.953690:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835422848 00000100:00100000:2.0:1789683460.953753:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 348 00000100:00100000:2.0:1789683460.953763:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f93123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+12:10781:x1876618835422848:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789683460.953960:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f93123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+12:10781:x1876618835422848:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 199us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683460.953970:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 348 00000100:00100000:0.0:1789683460.961117:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683460.961274:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835422976 00000100:00100000:1.0:1789683460.961312:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835422976 00000100:00100000:1.0:1789683460.961368:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 349 00000100:00100000:1.0:1789683460.961380:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+12:6175:x1876618835422976:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683460.961400:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683460.961504:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837db400/0xcf8485587b8898d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc513 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683460.961535:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837db400/0xcf8485587b8898d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc513 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683460.961546:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837db400/0xcf8485587b8898d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc513 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683460.961556:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837db400, rc 0) 00000100:00100000:1.0:1789683460.961691:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:6175:x1876618835422976:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 Request processed in 312us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683460.961698:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 349 00000100:00100000:0.0:1789683460.979222:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683460.979402:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835423104 00000100:00100000:2.0:1789683460.980485:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835423104 00000100:00100000:2.0:1789683460.980562:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 350 00000100:00100000:2.0:1789683460.980573:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:6175:x1876618835423104:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683460.980717:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:6175:x1876618835423104:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 Request processed in 147us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683460.980725:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 350 00000100:00100000:2.0:1789683460.985532:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683460.989402:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835423232 00000100:00100000:3.0:1789683460.989489:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835423232 00000100:00100000:3.0:1789683460.989569:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 351 00000100:00100000:3.0:1789683460.989580:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc2073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:6175:x1876618835423232:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683460.989741:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc2073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:6175:x1876618835423232:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 Request processed in 161us (4218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683460.989749:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 351 00000100:00100000:0.0:1789683460.997876:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683460.998443:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835423360 00000100:00100000:1.0:1789683460.998455:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835423360 00000100:00100000:1.0:1789683460.998513:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 352 00000100:00100000:1.0:1789683460.998524:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc2071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:10785:x1876618835423360:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789683460.998685:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc2071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:10785:x1876618835423360:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 162us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683460.998694:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 352 00000100:00100000:0.0:1789683461.003742:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683461.003865:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835423488 00000100:00100000:2.0:1789683461.003877:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835423488 00000100:00100000:2.0:1789683461.003944:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 353 00000100:00100000:2.0:1789683461.003954:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:10785:x1876618835423488:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789683461.004124:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:10785:x1876618835423488:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 170us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683461.004132:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 353 10000000:01000000:1.0:1789683461.086901:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789683461.086909:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0e827aa000 from 7 10000000:01000000:1.0:1789683461.086915:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789683461.086967:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837dae00/0xcf8485587b8898dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683461.086993:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0e837dae00/0xcf8485587b8898dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683461.087005:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0e837dae00/0xcf8485587b8898dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683461.087090:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850189056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789683461.087243:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683461.087397:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683461.087770:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850189056 00000100:00100000:3.0:1789683461.087780:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850189056 00000100:00100000:2.0:1789683461.088053:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789683461.088064:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:6518:x1876618850189056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683461.088079:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683461.088094:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb7a31000/0xcf8485587b8898e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8898dd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683461.088119:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb7a31000/0xcf8485587b8898e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8898dd expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683461.088143:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb7a31000/0xcf8485587b8898e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8898dd expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683461.088152:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31000, rc 0) 00000100:00100000:2.0:1789683461.088205:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850189056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683461.088211:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789683461.088290:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850189056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683461.088316:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0e837dae00/0xcf8485587b8898dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8898e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683461.088325:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0e837dae00/0xcf8485587b8898dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8898e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683461.088399:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850189184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683461.088430:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683461.088871:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683461.088966:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850189184 00000100:00100000:3.0:1789683461.088973:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850189184 00000100:00100000:3.0:1789683461.089001:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789683461.089008:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850189184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683461.089153:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850189184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683461.089160:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789683461.089276:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850189184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683461.089320:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850189312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683461.089367:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683461.089385:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683461.089520:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850189312 00000100:00100000:3.0:1789683461.089525:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850189312 00000100:00100000:3.0:1789683461.089544:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789683461.089550:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850189312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683461.089631:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850189312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683461.089638:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789683461.089716:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850189312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683461.090163:0:13800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:13800:1876618850189440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683461.090213:0:13800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683461.090243:0:13800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789683461.090409:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850189440 00000100:00100000:3.0:1789683461.090415:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850189440 00000100:00100000:3.0:1789683461.090439:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789683461.090445:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:13800:x1876618850189440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683461.090535:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:13800:x1876618850189440:12345-0@lo:502:llog_process_th.0 Request processed in 90us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683461.090548:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789683461.090631:0:13800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:13800:1876618850189440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789683461.090655:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683461.090665:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683461.090667:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789683461.090674:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0e827aa000 00000020:00000080:1.0:1789683461.090676:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789683461.090735:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683461.090739:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683461.090741:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789683461.090744:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683461.090746:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683461.090748:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789683461.090751:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0e827aa000 00000020:00000080:1.0:1789683461.090754:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789683461.090804:0:13800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:13800:1876618850189568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683461.090836:0:13800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683461.090860:0:13800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789683461.094704:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850189568 00000100:00100000:3.0:1789683461.094720:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850189568 00000100:00100000:3.0:1789683461.094767:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789683461.094776:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:13800:x1876618850189568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683461.094968:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:13800:x1876618850189568:12345-0@lo:502:llog_process_th.0 Request processed in 192us (4129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683461.094975:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789683461.096419:0:13800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:13800:1876618850189568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789683461.096464:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683461.096475:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683461.096477:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789683461.096482:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789683461.096643:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789683461.096666:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789683461.096676:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837dae00/0xcf8485587b8898dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8898e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683461.096701:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0e837dae00/0xcf8485587b8898dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8898e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683461.096711:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789683461.096713:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0fb62ea800 from 7 10000000:01000000:1.0:1789683461.096716:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789683461.096748:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b8898eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683461.096756:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b8898eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683461.096765:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b8898eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683461.096815:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850189696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789683461.096882:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683461.096916:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789683461.096936:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850189696 00000100:00100000:1.0:1789683461.096941:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850189696 00000100:00100000:1.0:1789683461.096974:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789683461.096981:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:6518:x1876618850189696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683461.096994:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683461.097006:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837db000/0xcf8485587b8898f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8898eb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683461.097028:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837db000/0xcf8485587b8898f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8898eb expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683461.097048:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837db000/0xcf8485587b8898f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8898eb expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683461.097057:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837db000, rc 0) 00000100:00100000:1.0:1789683461.097090:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850189696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683461.097096:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789683461.097292:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850189696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683461.097352:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b8898eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8898f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683461.097361:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b8898eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8898f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683461.097414:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850189824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683461.097441:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683461.097454:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789683461.097467:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850189824 00000100:00100000:1.0:1789683461.097470:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850189824 00000100:00100000:1.0:1789683461.097488:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789683461.097494:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850189824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683461.097600:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850189824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683461.097607:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789683461.097636:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850189824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683461.097670:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850189952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683461.097707:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683461.097720:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789683461.097732:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850189952 00000100:00100000:1.0:1789683461.097736:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850189952 00000100:00100000:1.0:1789683461.097752:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1789683461.097756:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850189952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683461.097865:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850189952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683461.097872:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1789683461.097907:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850189952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683461.098077:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:13802:1876618850190080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683461.098110:0:13802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683461.099678:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850190080 00000100:00100000:2.0:1789683461.099691:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850190080 00000100:00100000:2.0:1789683461.099743:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1789683461.099752:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:13802:x1876618850190080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683461.099917:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:13802:x1876618850190080:12345-0@lo:502:llog_process_th.0 Request processed in 165us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683461.099925:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1789683461.101897:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789683461.101936:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:13802:1876618850190080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789683461.101975:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683461.101987:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683461.101989:0:13802:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789683461.101996:0:13802:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0fb62ea800 00000020:00000080:0.0:1789683461.101998:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789683461.102069:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683461.102073:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683461.102075:0:13802:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789683461.102077:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683461.102080:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683461.102081:0:13802:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789683461.102084:0:13802:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0fb62ea800 00000020:00000080:0.0:1789683461.102086:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789683461.102148:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:13802:1876618850190208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683461.102218:0:13802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683461.102241:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683461.103583:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850190208 00000100:00100000:2.0:1789683461.103597:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850190208 00000100:00100000:2.0:1789683461.103646:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789683461.103654:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:13802:x1876618850190208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683461.103821:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:13802:x1876618850190208:12345-0@lo:502:llog_process_th.0 Request processed in 167us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683461.103835:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1789683461.104186:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:13802:1876618850190208:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789683461.104220:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683461.104228:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683461.104230:0:13802:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789683461.104234:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789683461.105132:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789683461.105166:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683461.105178:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b8898eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8898f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683461.105191:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b8898eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8898f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683461.105202:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789683461.105204:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0f88c59000 from 7 10000000:01000000:2.0:1789683461.105207:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683461.105241:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b8898f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683461.105248:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b8898f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683461.105259:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b8898f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683461.105283:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850190336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683461.105343:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683461.105377:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e836bd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683461.106007:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850190336 00000100:00100000:0.0:1789683461.106017:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850190336 00000100:00100000:0.0:1789683461.106073:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1789683461.106081:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:6518:x1876618850190336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683461.106094:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683461.106108:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454d200/0xcf8485587b889900 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b8898f9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683461.106144:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454d200/0xcf8485587b889900 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b8898f9 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683461.106154:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454d200/0xcf8485587b889900 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b8898f9 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683461.106162:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d200, rc 0) 00000100:00100000:0.0:1789683461.106207:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850190336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683461.106213:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1789683461.106260:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850190336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683461.106275:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b8898f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889900 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683461.106285:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b8898f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889900 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683461.106862:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850190464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683461.106900:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683461.106928:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb7922b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683461.106946:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850190464 00000100:00100000:0.0:1789683461.106951:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850190464 00000100:00100000:0.0:1789683461.106972:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1789683461.106977:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850190464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683461.107270:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850190464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683461.107276:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1789683461.107405:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850190464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683461.107434:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850190592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683461.107477:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683461.107504:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb7922b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683461.107519:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850190592 00000100:00100000:0.0:1789683461.107523:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850190592 00000100:00100000:0.0:1789683461.107542:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1789683461.107547:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850190592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683461.107623:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850190592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683461.107630:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1789683461.107666:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850190592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683461.107879:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:13804:1876618850190720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683461.107918:0:13804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683461.107936:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850190720 00000100:00100000:0.0:1789683461.107940:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850190720 00000100:00100000:0.0:1789683461.107957:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789683461.107962:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:13804:x1876618850190720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683461.112336:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:13804:x1876618850190720:12345-0@lo:502:llog_process_th.0 Request processed in 4363us (4407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683461.112352:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789683461.112443:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb7922c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683461.112471:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:13804:1876618850190720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789683461.112509:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683461.112519:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683461.112522:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789683461.112529:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0f88c59000 00000020:00000080:0.0:1789683461.112531:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789683461.112604:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683461.112607:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683461.112609:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789683461.112612:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683461.112614:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683461.112615:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789683461.112619:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0f88c59000 00000020:00000080:0.0:1789683461.112621:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789683461.112674:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:13804:1876618850190848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683461.112738:0:13804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683461.112760:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb7922c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683461.113960:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850190848 00000100:00100000:3.0:1789683461.113972:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850190848 00000100:00100000:3.0:1789683461.114017:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1789683461.114039:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa53c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:13804:x1876618850190848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683461.114199:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa53c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:13804:x1876618850190848:12345-0@lo:502:llog_process_th.0 Request processed in 174us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683461.114206:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789683461.114509:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:13804:1876618850190848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789683461.114540:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683461.114554:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683461.114557:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789683461.114562:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789683461.115228:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789683461.115255:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789683461.115264:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b8898f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889900 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683461.115276:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b8898f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889900 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683461.115288:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789683461.115290:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0f8bdba800 from 7 10000000:01000000:3.0:1789683461.115293:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789683461.115335:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176000/0xcf8485587b889907 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683461.115352:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176000/0xcf8485587b889907 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683461.115362:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176000/0xcf8485587b889907 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683461.115381:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850190976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789683461.115428:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683461.115470:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f845d3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683461.115578:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850190976 00000100:00100000:1.0:1789683461.115585:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850190976 00000100:00100000:1.0:1789683461.115632:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789683461.115640:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:6518:x1876618850190976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683461.115652:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683461.115665:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837da400/0xcf8485587b88990e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b889907 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683461.115687:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837da400/0xcf8485587b88990e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b889907 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683461.115698:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837da400/0xcf8485587b88990e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b889907 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683461.115717:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da400, rc 0) 00000100:00100000:1.0:1789683461.115755:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850190976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683461.115761:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789683461.115822:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850190976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683461.115834:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176000/0xcf8485587b889907 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88990e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683461.115861:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176000/0xcf8485587b889907 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88990e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683461.115919:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850191104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683461.115943:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683461.115955:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789683461.115968:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850191104 00000100:00100000:1.0:1789683461.115971:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850191104 00000100:00100000:1.0:1789683461.115992:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789683461.115998:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850191104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683461.116109:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850191104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683461.116115:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789683461.116154:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850191104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683461.116181:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850191232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683461.116218:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683461.116236:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789683461.116248:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850191232 00000100:00100000:1.0:1789683461.116252:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850191232 00000100:00100000:1.0:1789683461.116268:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789683461.116273:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850191232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683461.116357:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:6518:x1876618850191232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683461.116364:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789683461.116399:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e97b3c51-c653-4f2f-8e95-54cfcf70f127:6518:1876618850191232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683461.116573:0:13805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:13805:1876618850191360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683461.116607:0:13805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683461.116626:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850191360 00000100:00100000:1.0:1789683461.116629:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850191360 00000100:00100000:1.0:1789683461.116651:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789683461.116658:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:13805:x1876618850191360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683461.116721:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:13805:x1876618850191360:12345-0@lo:502:llog_process_th.0 Request processed in 63us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683461.116727:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789683461.116755:0:13805:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373e240 going to sleep for 11 seconds 00000100:00100000:1.0:1789683461.116766:0:13805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:13805:1876618850191360:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789683461.116805:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683461.116813:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683461.116815:0:13805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789683461.116822:0:13805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0f8bdba800 00000020:00000080:1.0:1789683461.116824:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789683461.116882:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683461.116892:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683461.116893:0:13805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789683461.116897:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683461.116899:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683461.116900:0:13805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789683461.116904:0:13805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0f8bdba800 00000020:00000080:1.0:1789683461.116906:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789683461.116937:0:13805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:13805:1876618850191488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683461.116968:0:13805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683461.116985:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850191488 00000100:00100000:1.0:1789683461.116989:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850191488 00000100:00100000:1.0:1789683461.117009:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1789683461.117014:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:13805:x1876618850191488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683461.117069:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:13805:x1876618850191488:12345-0@lo:502:llog_process_th.0 Request processed in 53us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683461.117075:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1789683461.117101:0:13805:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89c49000 going to sleep for 11 seconds 00000100:00100000:1.0:1789683461.117112:0:13805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e97b3c51-c653-4f2f-8e95-54cfcf70f127:13805:1876618850191488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789683461.117128:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683461.117132:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683461.117134:0:13805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789683461.117137:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789683461.117189:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789683461.117206:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789683461.117214:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176000/0xcf8485587b889907 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88990e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683461.117223:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176000/0xcf8485587b889907 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88990e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789683461.126118:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789683461.141263:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789683461.154755:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683461.217670:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850191616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683461.217746:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683461.218156:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850191616 00000100:00100000:0.0:1789683461.218165:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850191616 00000100:00100000:0.0:1789683461.218231:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789683461.218241:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850191616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789683461.218272:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683461.218329:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850191616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683461.218336:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1789683461.218489:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683461.220220:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850191616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683461.727179:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850191744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683461.727265:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683461.727359:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683461.727366:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850191872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683461.727393:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683461.727561:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850191744 00000100:00100000:3.0:1789683461.727569:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850191744 00000100:00100000:3.0:1789683461.727614:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789683461.727622:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850191744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789683461.727659:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789683461.727708:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850191744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683461.727715:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789683461.727843:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850191744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683461.727941:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850191872 00000100:00100000:3.0:1789683461.727946:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850191872 00000100:00100000:3.0:1789683461.727986:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789683461.727993:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1876618850191872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683461.728007:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683461.728037:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1876618850191872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683461.728043:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1789683461.728218:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683461.728245:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850191872:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789683462.176912:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789683462.177396:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789683462.178219:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789683463.200962:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683463.263018:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850192000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683463.263518:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683463.266149:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850192000 00000100:00100000:0.0:1789683463.266174:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850192000 00000100:00100000:0.0:1789683463.266257:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789683463.266271:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850192000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789683463.266308:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683463.266387:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850192000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (2869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683463.266405:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1789683463.266548:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789683463.266582:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0724e00 x1876618850192000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683463.266598:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850192000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683463.777852:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850192512:0@lo:400:kworker.0 00000100:00100000:3.0:1789683463.777953:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683463.778029:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850193024:0@lo:400:kworker.0 00000100:00100000:3.0:1789683463.778056:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683463.778077:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850193536:0@lo:400:kworker.0 00000100:00100000:3.0:1789683463.778096:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683463.778121:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789683463.778126:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850192128:0@lo:400:kworker.0 00000100:00100000:3.0:1789683463.778154:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683463.778172:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850192640:0@lo:400:kworker.0 00000100:00100000:3.0:1789683463.778194:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683463.778211:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850193152:0@lo:400:kworker.0 00000100:00100000:3.0:1789683463.778231:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683463.778261:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850193024 00000100:00100000:3.0:1789683463.778271:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850193024 00000100:00100000:3.0:1789683463.778342:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850193536 00000100:00100000:3.0:1789683463.778345:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850193536 00000100:00100000:3.0:1789683463.778366:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850193152 00000100:00100000:3.0:1789683463.778368:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850193152 00000100:00100000:3.0:1789683463.778405:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789683463.778414:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850193024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683463.778479:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850193024:12345-0@lo:400:kworker.0 Request processed in 66us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683463.778486:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789683463.778504:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789683463.778510:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850193536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683463.778673:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850193536:12345-0@lo:400:kworker.0 Request processed in 162us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683463.778680:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789683463.778692:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789683463.778698:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876618850193152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683463.778722:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876618850193152:12345-0@lo:400:kworker.0 Request processed in 25us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683463.778728:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789683463.778753:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850192640 00000100:00100000:3.0:1789683463.778756:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850192640 00000100:00100000:3.0:1789683463.778838:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789683463.778845:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850192640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683463.778882:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850192640:12345-0@lo:400:kworker.0 Request processed in 38us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683463.778888:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1789683463.778910:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789683463.778915:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683463.778956:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850192640:0@lo:400:kworker.0 00000100:00100000:3.0:1789683463.778969:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850193152:0@lo:400:kworker.0 00000100:00100000:3.0:1789683463.778992:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850193024:0@lo:400:kworker.0 00010000:00080000:3.0:1789683463.779005:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e82515880 x1876618850193536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683463.779016:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850193536:0@lo:400:kworker.0 00000100:00100000:2.0:1789683463.779186:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850192384:0@lo:400:kworker.0 00000100:00100000:2.0:1789683463.779266:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683463.779314:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850192896:0@lo:400:kworker.0 00000100:00100000:2.0:1789683463.779354:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683463.779372:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850193408:0@lo:400:kworker.0 00000100:00100000:2.0:1789683463.779392:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683463.779414:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789683463.779422:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850192256:0@lo:400:kworker.0 00000100:00100000:2.0:1789683463.779442:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683463.779460:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850192768:0@lo:400:kworker.0 00000100:00100000:2.0:1789683463.779481:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683463.779500:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850193280:0@lo:400:kworker.0 00000100:00100000:2.0:1789683463.779520:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683463.779547:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850192512 00000100:00100000:2.0:1789683463.779554:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850192512 00000100:00100000:2.0:1789683463.779593:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850192896 00000100:00100000:2.0:1789683463.779596:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850192896 00000100:00100000:2.0:1789683463.779620:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850193408 00000100:00100000:2.0:1789683463.779623:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850193408 00000100:00100000:2.0:1789683463.779636:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850192256 00000100:00100000:2.0:1789683463.779638:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850192256 00000100:00100000:2.0:1789683463.779648:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850192768 00000100:00100000:2.0:1789683463.779650:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850192768 00000100:00100000:2.0:1789683463.779661:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850193280 00000100:00100000:2.0:1789683463.779663:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850193280 00000100:00100000:2.0:1789683463.779678:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789683463.779686:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850192512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683463.779739:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850192512:12345-0@lo:400:kworker.0 Request processed in 54us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683463.779745:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789683463.779762:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789683463.779774:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850192896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683463.779853:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850192896:12345-0@lo:400:kworker.0 Request processed in 79us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683463.779858:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789683463.779872:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789683463.779879:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850193408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683463.779904:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850193408:12345-0@lo:400:kworker.0 Request processed in 27us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683463.779910:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789683463.779921:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789683463.779927:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850192256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683463.779949:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850192256:12345-0@lo:400:kworker.0 Request processed in 24us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683463.779954:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789683463.779966:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789683463.779971:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850192768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683463.779996:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850192768:12345-0@lo:400:kworker.0 Request processed in 25us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683463.780001:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789683463.780013:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789683463.780019:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850193280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683463.780042:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850193280:12345-0@lo:400:kworker.0 Request processed in 24us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683463.780047:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:2.0:1789683463.780067:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683463.780076:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789683463.780102:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850192256:0@lo:400:kworker.0 00000100:00100000:2.0:1789683463.780111:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850192768:0@lo:400:kworker.0 00000100:00100000:2.0:1789683463.780119:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850193280:0@lo:400:kworker.0 00010000:00080000:2.0:1789683463.780129:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83db4700 x1876618850192896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683463.780138:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850192896:0@lo:400:kworker.0 00010000:00080000:2.0:1789683463.780146:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e82517b80 x1876618850193408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683463.780154:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850193408:0@lo:400:kworker.0 00000100:00100000:3.0:1789683463.780412:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850192384 00000100:00100000:3.0:1789683463.780421:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850192384 00000100:00100000:3.0:1789683463.780476:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789683463.780484:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850192384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683463.780642:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850192128 00000100:00100000:1.0:1789683463.780647:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850192128 00000100:00100000:1.0:1789683463.780684:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789683463.780691:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850192128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683463.780910:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850193664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683463.781088:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850192512:0@lo:400:kworker.0 00000100:00100000:1.0:1789683463.784710:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850192128:12345-0@lo:400:kworker.0 Request processed in 4006us (6540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683463.784729:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1789683463.786346:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850192128:0@lo:400:kworker.0 00000100:00100000:3.0:1789683463.792012:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850192384:12345-0@lo:400:kworker.0 Request processed in 11515us (12732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683463.792032:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789683463.792247:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850192384:0@lo:400:kworker.0 00000100:00100000:0.0:1789683463.793008:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683463.793197:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850193664 00000100:00100000:3.0:1789683463.793209:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850193664 00000100:00100000:3.0:1789683463.793276:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789683463.793301:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850193664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683463.793342:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683463.793409:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850193664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683463.793416:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:0.0:1789683463.793517:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb6170700 x1876618850193664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683463.793547:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850193664:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789683464.223098:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789683464.809989:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:1.0:1789683465.251886:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683465.749890:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683465.749935:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683465.749963:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683465.749977:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683465.749994:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683465.750013:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683465.750054:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835423872 00000100:00100000:3.0:1789683465.750064:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835423872 00000100:00100000:1.0:1789683465.750091:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835424128 00000100:00100000:1.0:1789683465.750098:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835424128 00000100:00100000:3.0:1789683465.750122:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835423744 00000100:00100000:3.0:1789683465.750127:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835423744 00000100:00100000:1.0:1789683465.750128:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835424256 00000100:00100000:1.0:1789683465.750133:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835424256 00000100:00100000:3.0:1789683465.750154:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 235 00000100:00100000:0.0:1789683465.750200:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835423616 00000100:00100000:0.0:1789683465.750205:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835423616 00000100:00100000:3.0:1789683465.750237:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835423872:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683465.750251:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 375 00000100:00100000:0.0:1789683465.750275:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:2403:x1876618835423616:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683465.750306:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835423872:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 143us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683465.750315:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:2403:x1876618835423616:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 42us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683465.750329:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 375 00000100:00100000:1.0:1789683465.753328:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 236 00000100:00100000:1.0:1789683465.753354:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835424128:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683465.753453:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835424128:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 113us (3487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683465.753461:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 236 00000100:00100000:1.0:1789683465.753486:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 237 00000100:00100000:1.0:1789683465.753509:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835423744:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683465.753539:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835423744:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 32us (3560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683465.753546:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 237 00000100:00100000:1.0:1789683465.753561:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 238 00000100:00100000:1.0:1789683465.753568:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835424256:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683465.753594:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835424256:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 28us (3581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683465.753600:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 238 00000100:00100000:1.0:1789683465.753982:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835424000 00000100:00100000:1.0:1789683465.753991:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835424000 00000100:00100000:1.0:1789683465.754106:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 93 00000100:00100000:1.0:1789683465.754115:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835424000:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683465.754152:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835424000:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 38us (4155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683465.754159:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 93 00000100:00080000:1.0:1789683465.754191:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683465.754196:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683465.754199:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683465.760999:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 235 00000100:00100000:0.0:1789683465.823181:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850193792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683465.823265:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683465.823517:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850193792 00000100:00100000:3.0:1789683465.823526:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850193792 00000100:00100000:3.0:1789683465.823573:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789683465.823584:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850193792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789683465.823622:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789683465.823694:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850193792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683465.823701:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789683465.824384:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850193792:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789683466.271096:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683466.335120:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683466.335146:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850193920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683466.335219:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683466.335374:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850193920 00000100:00100000:3.0:1789683466.335382:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850193920 00000100:00100000:3.0:1789683466.335453:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789683466.335465:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850193920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789683466.335497:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683466.335548:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850193920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683466.335555:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1789683466.335880:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683466.335922:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850193920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683466.847955:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683466.847982:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850194048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683466.848063:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683466.848824:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850194048 00000100:00100000:3.0:1789683466.848849:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850194048 00000100:00100000:3.0:1789683466.848936:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789683466.848947:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850194048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683466.848972:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683466.849033:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850194048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683466.849040:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789683466.849153:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1789683466.849160:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0fb7961c00, transno 4294967301 00000100:00100000:0.0:1789683466.849190:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850194048:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789683466.849513:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683466.849523:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683466.849534:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850194176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789683466.849581:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683466.849671:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850194176 00000100:00100000:1.0:1789683466.849678:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850194176 00000100:00100000:1.0:1789683466.849727:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789683466.849743:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850194176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683466.849771:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789683466.849835:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850194176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683466.849848:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789683466.850210:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850194176:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789683467.296725:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683468.325535:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683468.389420:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683468.389443:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb790c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850194304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683468.389519:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683468.389847:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850194304 00000100:00100000:3.0:1789683468.389856:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850194304 00000100:00100000:3.0:1789683468.389919:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789683468.389929:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850194304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789683468.389959:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683468.390009:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850194304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683468.390017:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:3.0:1789683468.390065:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb790c380 x1876618850194304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683468.390084:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb790c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850194304:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789683468.390179:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789683468.895829:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850194816:0@lo:400:kworker.0 00000100:00100000:2.0:1789683468.895950:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683468.896017:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850195328:0@lo:400:kworker.0 00000100:00100000:2.0:1789683468.896040:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683468.896065:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789683468.896071:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850194432:0@lo:400:kworker.0 00000100:00100000:2.0:1789683468.896097:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683468.896118:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850194944:0@lo:400:kworker.0 00000100:00100000:2.0:1789683468.896152:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683468.896169:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850195456:0@lo:400:kworker.0 00000100:00100000:2.0:1789683468.896191:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683468.896222:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850194816 00000100:00100000:2.0:1789683468.896231:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850194816 00000100:00100000:2.0:1789683468.896288:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789683468.896297:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850194816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683468.896345:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850194816:12345-0@lo:400:kworker.0 Request processed in 49us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683468.896352:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789683468.896373:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850194432 00000100:00100000:2.0:1789683468.896377:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850194432 00000100:00100000:2.0:1789683468.896398:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1789683468.896405:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3649:x1876618850194432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683468.896454:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3649:x1876618850194432:12345-0@lo:400:kworker.0 Request processed in 49us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683468.896461:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1789683468.896490:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850194944 00000100:00100000:2.0:1789683468.896494:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850194944 00000100:00100000:2.0:1789683468.896521:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789683468.896529:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850194944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683468.896560:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850194944:12345-0@lo:400:kworker.0 Request processed in 32us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683468.896565:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789683468.896599:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850194432:0@lo:400:kworker.0 00000100:00100000:2.0:1789683468.896609:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850194944:0@lo:400:kworker.0 00000100:00100000:2.0:1789683468.896617:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850194816:0@lo:400:kworker.0 00000100:00100000:3.0:1789683468.897850:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850195328 00000100:00100000:3.0:1789683468.897875:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850195328 00000100:00100000:3.0:1789683468.897947:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850195456 00000100:00100000:3.0:1789683468.897950:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850195456 00000100:00100000:3.0:1789683468.897976:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789683468.897985:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850195328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683468.898057:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850195328:12345-0@lo:400:kworker.0 Request processed in 74us (2015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683468.898079:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789683468.898094:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789683468.898101:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850195456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683468.898130:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850195456:12345-0@lo:400:kworker.0 Request processed in 30us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683468.898135:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789683468.898536:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850194688:0@lo:400:kworker.0 00000100:00100000:3.0:1789683468.898578:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683468.898616:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850195200:0@lo:400:kworker.0 00000100:00100000:3.0:1789683468.898643:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683468.898676:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789683468.898683:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850194560:0@lo:400:kworker.0 00000100:00100000:3.0:1789683468.898740:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683468.898762:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850195072:0@lo:400:kworker.0 00000100:00100000:3.0:1789683468.898806:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683468.898835:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850195200 00000100:00100000:3.0:1789683468.898841:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850195200 00000100:00100000:0.0:1789683468.899460:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850194560 00000100:00100000:0.0:1789683468.899479:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850194560 00000100:00100000:0.0:1789683468.899513:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850195072 00000100:00100000:0.0:1789683468.899516:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850195072 00000100:00100000:0.0:1789683468.899533:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789683468.899541:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850194560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683468.899612:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850194560:12345-0@lo:400:kworker.0 Request processed in 59us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683468.899618:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789683468.899635:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789683468.899641:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850195072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683468.899682:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850195072:12345-0@lo:400:kworker.0 Request processed in 41us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683468.899688:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789683468.899772:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850195584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683468.899823:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683468.900086:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850194560:0@lo:400:kworker.0 00000100:00100000:0.0:1789683468.900099:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8374a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850195072:0@lo:400:kworker.0 00000100:00100000:3.0:1789683468.900207:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789683468.900216:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850195200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683468.900259:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850195200:12345-0@lo:400:kworker.0 Request processed in 46us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683468.900266:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789683468.900285:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850195584 00000100:00100000:3.0:1789683468.900289:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850195584 00000100:00100000:3.0:1789683468.900317:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789683468.900333:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850195584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683468.900349:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683468.900386:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850195584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683468.900392:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1789683468.900421:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83748e00 x1876618850195200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683468.900433:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850195200:0@lo:400:kworker.0 00010000:00080000:3.0:1789683468.900456:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7961c00 x1876618850195584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683468.900468:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850195584:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789683468.900552:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683468.900557:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683468.900559:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789683468.900562:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683468.900574:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850194688 00000100:00100000:2.0:1789683468.900579:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850194688 00000100:00100000:2.0:1789683468.900619:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789683468.900626:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb790c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850194688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683468.900673:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb790c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850194688:12345-0@lo:400:kworker.0 Request processed in 48us (2094us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683468.900679:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789683468.900721:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850194688:0@lo:400:kworker.0 00000100:00100000:2.0:1789683468.900756:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850195456:0@lo:400:kworker.0 00000100:00100000:2.0:1789683468.900768:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850195328:0@lo:400:kworker.0 00000100:00100000:0.0:1789683468.901096:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683468.901133:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683468.901142:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850195840:0@lo:400:kworker.0 00000100:00100000:1.0:1789683468.901172:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683468.901250:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850195840 00000100:00100000:3.0:1789683468.901254:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850195840 00000100:00100000:3.0:1789683468.901292:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789683468.901297:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850195840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683468.901330:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850195840:12345-0@lo:400:kworker.0 Request processed in 33us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683468.901335:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00010000:00080000:3.0:1789683468.901357:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e82fe5180 x1876618850195840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683468.901366:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850195840:0@lo:400:kworker.0 00000100:00080000:1.0:1789683468.901466:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789683468.910582:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850195712:0@lo:400:kworker.0 00000100:00100000:0.0:1789683468.910848:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683468.911040:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850195712 00000100:00100000:2.0:1789683468.911049:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850195712 00000100:00100000:2.0:1789683468.911128:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789683468.911139:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850195712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683468.911213:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850195712:12345-0@lo:400:kworker.0 Request processed in 76us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683468.911221:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1789683468.911355:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683468.911427:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850195712:0@lo:400:kworker.0 00010000:00010000:1.0:1789683469.348199:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683470.371513:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683470.872290:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683470.872336:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683470.872408:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835424512 00000100:00100000:2.0:1789683470.872418:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835424512 00000100:00100000:2.0:1789683470.872482:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 245 00000100:00100000:2.0:1789683470.872492:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835424512:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683470.872566:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835424512:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 76us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683470.872573:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 245 00000100:00080000:2.0:1789683470.872595:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683470.875155:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683470.875194:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683470.875227:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683470.875252:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683470.875289:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835424384 00000100:00100000:0.0:1789683470.875299:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835424384 00000100:00100000:0.0:1789683470.875365:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 377 00000100:00100000:0.0:1789683470.875375:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:2405:x1876618835424384:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683470.875441:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:2405:x1876618835424384:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 68us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683470.875449:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 377 00000100:00100000:0.0:1789683470.875482:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835425024 00000100:00100000:0.0:1789683470.875486:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835425024 00000100:00100000:0.0:1789683470.875519:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835424640 00000100:00100000:0.0:1789683470.875522:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835424640 00000100:00100000:0.0:1789683470.875542:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835424896 00000100:00100000:0.0:1789683470.875545:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835424896 00000100:00100000:0.0:1789683470.875560:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 246 00000100:00100000:0.0:1789683470.875567:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835425024:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683470.875599:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835425024:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 32us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683470.875617:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 246 00000100:00100000:0.0:1789683470.875631:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 247 00000100:00100000:0.0:1789683470.875637:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835424640:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683470.875660:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835424640:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 24us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683470.875676:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 247 00000100:00100000:0.0:1789683470.875690:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 248 00000100:00100000:0.0:1789683470.876073:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835424896:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683470.876102:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835424896:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 34us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683470.876109:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 248 00000100:00080000:0.0:1789683470.876249:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683470.876253:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683470.879538:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835424768 00000100:00100000:3.0:1789683470.879557:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835424768 00000100:00100000:1.0:1789683470.884914:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 96 00000100:00100000:1.0:1789683470.884935:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835424768:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683470.885036:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835424768:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 108us (12699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683470.885044:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 96 00000100:00080000:2.0:1789683470.885743:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683470.956763:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850195968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683470.956878:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683470.957555:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850195968 00000100:00100000:2.0:1789683470.957565:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850195968 00000100:00100000:2.0:1789683470.957627:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789683470.957636:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850195968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789683470.957682:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789683470.957752:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850195968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683470.957759:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789683470.957843:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850195968:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789683471.393669:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683471.455092:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850196096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683471.455162:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683471.455327:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850196096 00000100:00100000:0.0:1789683471.455335:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850196096 00000100:00100000:0.0:1789683471.455415:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789683471.455426:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850196096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789683471.455455:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683471.455503:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850196096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683471.455509:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1789683471.455987:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683471.456023:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850196096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683471.967149:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683471.967170:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850196224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683471.967259:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683471.967331:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850196224 00000100:00100000:3.0:1789683471.967338:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850196224 00000100:00100000:3.0:1789683471.967393:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789683471.967414:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850196224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683471.967439:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683471.967484:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850196224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683471.967490:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1789683471.967529:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683471.967560:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850196224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683471.968850:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850196352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789683471.968897:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683471.968990:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850196352 00000100:00100000:0.0:1789683471.968997:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850196352 00000100:00100000:0.0:1789683471.969040:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789683471.969048:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850196352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789683471.969089:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789683471.969143:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850196352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683471.969149:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789683471.970953:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850196352:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789683472.415474:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789683472.416527:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789683472.417662:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789683473.442225:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683473.504490:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683473.504515:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850196480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683473.504589:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683473.505015:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850196480 00000100:00100000:3.0:1789683473.505023:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850196480 00000100:00100000:3.0:1789683473.505092:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789683473.505103:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850196480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789683473.505139:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683473.505191:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850196480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683473.505216:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:1.0:1789683473.505361:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7999880 x1876618850196480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683473.505381:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850196480:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789683473.505514:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683474.015203:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850196608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683474.015281:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683474.015445:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850196608 00000100:00100000:0.0:1789683474.015454:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850196608 00000100:00100000:0.0:1789683474.015524:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789683474.015548:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850196608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683474.015586:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683474.015647:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850196608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683474.015654:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1789683474.015719:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789683474.015749:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f88c75c00 x1876618850196608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683474.015769:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850196608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683474.017198:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850196992:0@lo:400:kworker.0 00000100:00100000:2.0:1789683474.017255:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683474.017305:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850197504:0@lo:400:kworker.0 00000100:00100000:2.0:1789683474.017330:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683474.017363:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850198016:0@lo:400:kworker.0 00000100:00100000:2.0:1789683474.017384:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683474.017405:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789683474.017410:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850196864:0@lo:400:kworker.0 00000100:00100000:2.0:1789683474.017435:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683474.017455:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850197376:0@lo:400:kworker.0 00000100:00100000:2.0:1789683474.017474:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683474.017489:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850197888:0@lo:400:kworker.0 00000100:00100000:2.0:1789683474.017507:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683474.017534:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850197504 00000100:00100000:2.0:1789683474.017540:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850197504 00000100:00100000:2.0:1789683474.017578:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850198016 00000100:00100000:2.0:1789683474.017581:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850198016 00000100:00100000:2.0:1789683474.017594:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850196864 00000100:00100000:2.0:1789683474.017596:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850196864 00000100:00100000:2.0:1789683474.017606:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850197376 00000100:00100000:2.0:1789683474.017619:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850197376 00000100:00100000:2.0:1789683474.017631:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850197888 00000100:00100000:2.0:1789683474.017633:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850197888 00000100:00100000:2.0:1789683474.017663:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789683474.017669:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850197504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683474.017719:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850197504:12345-0@lo:400:kworker.0 Request processed in 50us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683474.017725:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789683474.017740:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789683474.017745:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850198016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683474.017769:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850198016:12345-0@lo:400:kworker.0 Request processed in 25us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683474.017774:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789683474.017811:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789683474.017830:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789683474.017837:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8374a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850197376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683474.017864:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8374a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850197376:12345-0@lo:400:kworker.0 Request processed in 29us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683474.017869:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789683474.017883:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789683474.017889:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8374a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850197888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683474.017913:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8374a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850197888:12345-0@lo:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683474.017918:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789683474.017945:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850196864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683474.017971:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850196864:12345-0@lo:400:kworker.0 Request processed in 154us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683474.017977:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789683474.018020:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850196864:0@lo:400:kworker.0 00000100:00100000:2.0:1789683474.018031:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850197376:0@lo:400:kworker.0 00000100:00100000:2.0:1789683474.018039:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850197888:0@lo:400:kworker.0 00010000:00080000:2.0:1789683474.018050:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc14ad880 x1876618850197504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683474.018059:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850197504:0@lo:400:kworker.0 00010000:00080000:2.0:1789683474.018068:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d17100 x1876618850198016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683474.018076:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850198016:0@lo:400:kworker.0 00000100:00100000:1.0:1789683474.018318:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850196736:0@lo:400:kworker.0 00000100:00100000:1.0:1789683474.018369:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683474.018407:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850197248:0@lo:400:kworker.0 00000100:00100000:1.0:1789683474.018433:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683474.018453:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850197760:0@lo:400:kworker.0 00000100:00100000:1.0:1789683474.018476:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683474.018493:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789683474.018499:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850197120:0@lo:400:kworker.0 00000100:00100000:1.0:1789683474.018520:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683474.018537:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850197632:0@lo:400:kworker.0 00000100:00100000:1.0:1789683474.018559:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683474.018573:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850198144:0@lo:400:kworker.0 00000100:00100000:1.0:1789683474.018592:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683474.018630:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850197760 00000100:00100000:1.0:1789683474.018634:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850197760 00000100:00100000:1.0:1789683474.018661:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850197632 00000100:00100000:1.0:1789683474.018664:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850197632 00000100:00100000:1.0:1789683474.018677:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850198144 00000100:00100000:1.0:1789683474.018680:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850198144 00000100:00100000:1.0:1789683474.018692:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789683474.018699:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850197760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683474.018736:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850197760:12345-0@lo:400:kworker.0 Request processed in 37us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683474.018742:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789683474.018756:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789683474.018762:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850197632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683474.018821:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850197632:12345-0@lo:400:kworker.0 Request processed in 59us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683474.018828:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789683474.018840:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789683474.018846:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850198144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683474.018874:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850198144:12345-0@lo:400:kworker.0 Request processed in 29us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683474.018880:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789683474.018894:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850197120 00000100:00100000:1.0:1789683474.018898:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850197120 00000100:00100000:1.0:1789683474.018922:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789683474.018927:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850197120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683474.018956:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850197120:12345-0@lo:400:kworker.0 Request processed in 29us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683474.018962:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789683474.018982:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850196992 00000100:00100000:1.0:1789683474.018985:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850196992 00000100:00100000:1.0:1789683474.019008:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850197248 00000100:00100000:1.0:1789683474.019011:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850197248 00000100:00100000:1.0:1789683474.019023:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789683474.019029:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850196992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683474.019065:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850196992:12345-0@lo:400:kworker.0 Request processed in 36us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683474.019071:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789683474.019083:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789683474.019089:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850197248:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789683474.019289:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789683474.019295:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683474.019297:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683474.019435:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850197120:0@lo:400:kworker.0 00000100:00100000:3.0:1789683474.019446:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850197632:0@lo:400:kworker.0 00010000:00080000:3.0:1789683474.019456:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d14a80 x1876618850198144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683474.019466:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850198144:0@lo:400:kworker.0 00000100:00100000:3.0:1789683474.019475:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850197760:0@lo:400:kworker.0 00000100:00100000:3.0:1789683474.019518:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850196992:0@lo:400:kworker.0 00000100:00100000:1.0:1789683474.019660:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850197248:12345-0@lo:400:kworker.0 Request processed in 571us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683474.019668:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789683474.019816:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850196736 00000100:00100000:2.0:1789683474.019822:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850196736 00000100:00100000:2.0:1789683474.019859:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1789683474.019865:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850196736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683474.019897:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850196736:12345-0@lo:400:kworker.0 Request processed in 33us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683474.019903:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1789683474.020235:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850196736:0@lo:400:kworker.0 00000100:00100000:3.0:1789683474.020249:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850197248:0@lo:400:kworker.0 00010000:00010000:0.0:1789683474.464933:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683475.487133:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683475.990846:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683475.990918:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683475.990958:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683475.991041:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835425152 00000100:00100000:1.0:1789683475.991052:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835425152 00000100:00100000:1.0:1789683475.991117:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 379 00000100:00100000:1.0:1789683475.991127:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa729a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:2404:x1876618835425152:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683475.991195:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa729a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:2404:x1876618835425152:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 70us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683475.991203:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 379 00000100:00100000:2.0:1789683475.993927:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835425408 00000100:00100000:2.0:1789683475.993942:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835425408 00000100:00100000:2.0:1789683475.994025:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835425280 00000100:00100000:2.0:1789683475.994029:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835425280 00000100:00100000:3.0:1789683475.994051:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 255 00000100:00100000:3.0:1789683475.994069:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835425408:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683475.994202:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835425408:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 140us (3282us total) trans 0 rc 0/0 00000100:00080000:0.0:1789683475.997524:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683475.997534:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789683476.004956:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683476.005059:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683476.005092:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683476.005137:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835425536 00000100:00100000:0.0:1789683476.005159:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835425536 00000100:00100000:0.0:1789683476.005230:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:0.0:1789683476.005239:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2401:x1876618835425536:12345-192.168.201.50@tcp:9:kworker.0 00000020:00000080:0.0:1789683476.005271:0:8440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889835 00000100:00080000:0.0:1789683476.005280:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d4a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789683476.005323:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1789683476.005503:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+2:2401:x1876618835425536:12345-192.168.201.50@tcp:9:kworker.0 Request processed in 264us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683476.005510:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 27 00010000:00010000:0.0:1789683476.005531:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789683476.005539:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683476.005556:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835425664 00000100:00100000:0.0:1789683476.005560:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835425664 00000100:00100000:3.0:1789683476.005656:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835425792 00000100:00100000:3.0:1789683476.005660:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835425792 00000100:00100000:2.0:1789683476.005715:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 256 00000100:00100000:2.0:1789683476.005749:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835425280:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683476.005800:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835425280:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 71us (14842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683476.005818:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 256 00000100:00100000:2.0:1789683476.005843:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 257 00000100:00100000:2.0:1789683476.005850:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835425792:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683476.005882:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835425792:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 33us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683476.006266:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 257 00000100:00080000:2.0:1789683476.006305:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789683476.006309:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683476.016050:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 255 00000100:00100000:0.0:1789683476.016130:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 258 00000100:00100000:0.0:1789683476.016214:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835425664:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683476.017679:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835425664:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 1531us (12724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683476.017691:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 258 00000100:00100000:1.0:1789683476.065141:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850198272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683476.065273:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683476.067751:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850198272 00000100:00100000:3.0:1789683476.067767:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850198272 00000100:00100000:3.0:1789683476.067885:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789683476.067895:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850198272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789683476.067937:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789683476.068021:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850198272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (2748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683476.068028:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789683476.068347:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850198272:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789683476.511263:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683476.575084:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683476.575113:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850198400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683476.575187:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683476.575255:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850198400 00000100:00100000:0.0:1789683476.575266:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850198400 00000100:00100000:0.0:1789683476.575332:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1789683476.575375:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683476.575410:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850198400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789683476.575446:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683476.575506:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850198400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 165us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683476.575593:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850198400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683476.586606:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789683477.087424:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850198528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683477.087715:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683477.087889:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850198528 00000100:00100000:0.0:1789683477.087898:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850198528 00000100:00100000:0.0:1789683477.087979:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789683477.087989:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8374b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850198528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683477.088015:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683477.088065:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8374b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850198528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683477.088072:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1789683477.088356:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683477.088395:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850198528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683477.088771:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850198656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683477.088856:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683477.089185:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850198656 00000100:00100000:2.0:1789683477.089191:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850198656 00000100:00100000:2.0:1789683477.089235:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789683477.089242:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850198656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683477.089276:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789683477.089329:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850198656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683477.089336:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789683477.089591:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850198656:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789683477.538206:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683478.558956:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683478.624297:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850198784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683478.624372:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683478.624596:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850198784 00000100:00100000:0.0:1789683478.624605:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850198784 00000100:00100000:0.0:1789683478.624695:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789683478.624703:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850198784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789683478.624735:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789683478.624805:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683478.625350:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850198784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 646us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683478.625359:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:1.0:1789683478.625466:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83d15f80 x1876618850198784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683478.625485:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850198784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683479.135625:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850199168:0@lo:400:kworker.0 00000100:00100000:3.0:1789683479.135701:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683479.135768:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850199680:0@lo:400:kworker.0 00000100:00100000:3.0:1789683479.135815:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683479.135835:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f852e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1876618850200192:0@lo:400:kworker.0 00000100:00100000:3.0:1789683479.135856:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683479.135883:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789683479.135889:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850199296:0@lo:400:kworker.0 00000100:00100000:3.0:1789683479.135908:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683479.135937:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850199808:0@lo:400:kworker.0 00000100:00100000:3.0:1789683479.135961:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683479.135978:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f852e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850200320:0@lo:400:kworker.0 00000100:00100000:3.0:1789683479.135997:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683479.136027:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850199168 00000100:00100000:3.0:1789683479.136034:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850199168 00000100:00100000:3.0:1789683479.136086:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789683479.136095:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850199168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683479.136153:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850199168:12345-0@lo:400:kworker.0 Request processed in 59us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683479.136160:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789683479.136183:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850199680 00000100:00100000:3.0:1789683479.136186:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850199680 00000100:00100000:3.0:1789683479.136219:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850200192 00000100:00100000:3.0:1789683479.136221:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850200192 00000100:00100000:3.0:1789683479.136239:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850199296 00000100:00100000:3.0:1789683479.136241:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850199296 00000100:00100000:3.0:1789683479.136253:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789683479.136259:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850199680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683479.136291:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850199680:12345-0@lo:400:kworker.0 Request processed in 32us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683479.136295:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789683479.136306:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789683479.136311:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876618850200192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683479.136334:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876618850200192:12345-0@lo:400:kworker.0 Request processed in 24us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683479.136339:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789683479.136362:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789683479.136368:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850199296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683479.136398:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850199296:12345-0@lo:400:kworker.0 Request processed in 31us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683479.136403:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789683479.136423:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850199808 00000100:00100000:3.0:1789683479.136426:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850199808 00000100:00100000:3.0:1789683479.136447:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850200320 00000100:00100000:3.0:1789683479.136450:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850200320 00000100:00100000:3.0:1789683479.136466:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789683479.136472:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850199808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683479.136500:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850199808:12345-0@lo:400:kworker.0 Request processed in 28us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683479.136505:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789683479.136531:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789683479.136538:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850200320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683479.136564:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850200320:12345-0@lo:400:kworker.0 Request processed in 28us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683479.136569:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1789683479.136590:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789683479.136594:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683479.136627:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850199296:0@lo:400:kworker.0 00000100:00100000:3.0:1789683479.136637:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850199808:0@lo:400:kworker.0 00010000:00080000:3.0:1789683479.136649:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f852e8700 x1876618850200320/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683479.136658:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f852e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850200320:0@lo:400:kworker.0 00000100:00100000:3.0:1789683479.136676:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850199168:0@lo:400:kworker.0 00010000:00080000:3.0:1789683479.136685:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83762300 x1876618850199680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683479.136693:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850199680:0@lo:400:kworker.0 00010000:00080000:3.0:1789683479.136702:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f852e9180 x1876618850200192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683479.136709:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f852e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1876618850200192:0@lo:400:kworker.0 00000100:00100000:1.0:1789683479.136975:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850198912:0@lo:400:kworker.0 00000100:00100000:1.0:1789683479.137014:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683479.137068:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850199424:0@lo:400:kworker.0 00000100:00100000:1.0:1789683479.137105:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683479.137124:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f89081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850199936:0@lo:400:kworker.0 00000100:00100000:1.0:1789683479.137146:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683479.137159:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f852ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850200448:0@lo:400:kworker.0 00000100:00100000:1.0:1789683479.137178:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683479.137194:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789683479.137200:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850199040:0@lo:400:kworker.0 00000100:00100000:1.0:1789683479.137220:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683479.137234:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850199552:0@lo:400:kworker.0 00000100:00100000:1.0:1789683479.137252:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683479.137265:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f852eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850200064:0@lo:400:kworker.0 00000100:00100000:1.0:1789683479.137283:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683479.137304:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850199040 00000100:00100000:1.0:1789683479.137308:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850199040 00000100:00100000:1.0:1789683479.137329:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850199552 00000100:00100000:1.0:1789683479.137332:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850199552 00000100:00100000:1.0:1789683479.137347:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850200064 00000100:00100000:1.0:1789683479.137349:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850200064 00000100:00100000:1.0:1789683479.137362:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789683479.137367:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850199040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683479.137407:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850199040:12345-0@lo:400:kworker.0 Request processed in 39us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683479.137413:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789683479.137428:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789683479.137434:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850199552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683479.137470:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850199552:12345-0@lo:400:kworker.0 Request processed in 37us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683479.137476:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789683479.137488:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789683479.137494:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850200064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683479.137530:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850200064:12345-0@lo:400:kworker.0 Request processed in 36us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683479.137536:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789683479.137574:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850199040:0@lo:400:kworker.0 00000100:00100000:1.0:1789683479.137584:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850199552:0@lo:400:kworker.0 00000100:00100000:1.0:1789683479.137591:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f852eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850200064:0@lo:400:kworker.0 00000100:00100000:0.0:1789683479.137875:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850199936 00000100:00100000:0.0:1789683479.137879:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850199936 00000100:00100000:0.0:1789683479.137904:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850200448 00000100:00100000:0.0:1789683479.137908:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850200448 00000100:00100000:0.0:1789683479.137923:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789683479.137929:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850199936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683479.137969:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850199936:12345-0@lo:400:kworker.0 Request processed in 40us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683479.137975:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789683479.137988:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789683479.137993:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850200448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683479.138019:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850200448:12345-0@lo:400:kworker.0 Request processed in 26us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683479.138025:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789683479.138218:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850198912 00000100:00100000:3.0:1789683479.138223:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850198912 00000100:00100000:2.0:1789683479.138349:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850200576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683479.138383:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683479.138437:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850200576 00000100:00100000:2.0:1789683479.138448:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850200576 00000100:00100000:2.0:1789683479.138477:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789683479.138483:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850200576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683479.138499:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683479.138555:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850200576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683479.138562:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:2.0:1789683479.138594:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7a40a80 x1876618850200576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683479.138612:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850200576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683479.138656:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850199424 00000100:00100000:2.0:1789683479.138659:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850199424 00000100:00100000:2.0:1789683479.138686:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789683479.138693:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850199424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683479.138728:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850199424:12345-0@lo:400:kworker.0 Request processed in 36us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683479.138733:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1789683479.138774:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683479.138778:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789683479.138813:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683479.138886:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1789683479.138896:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3649:x1876618850198912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683479.138931:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3649:x1876618850198912:12345-0@lo:400:kworker.0 Request processed in 37us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683479.138936:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1789683479.139017:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850198912:0@lo:400:kworker.0 00000100:00100000:1.0:1789683479.139029:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850199424:0@lo:400:kworker.0 00000100:00100000:1.0:1789683479.139038:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f89081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850199936:0@lo:400:kworker.0 00010000:00080000:1.0:1789683479.139048:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0f852ea680 x1876618850200448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683479.139068:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f852ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850200448:0@lo:400:kworker.0 00010000:00010000:0.0:1789683479.583425:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683480.607076:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683481.119149:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683481.119190:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683481.119226:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683481.119245:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683481.119286:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683481.119322:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835425920 00000100:00100000:1.0:1789683481.119641:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835425920 00000100:00100000:1.0:1789683481.119701:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 381 00000100:00100000:1.0:1789683481.119712:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:2405:x1876618835425920:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683481.119780:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:2405:x1876618835425920:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 70us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683481.119814:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 381 00000100:00100000:1.0:1789683481.119848:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835426176 00000100:00100000:1.0:1789683481.119852:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835426176 00000100:00100000:1.0:1789683481.119887:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835426432 00000100:00100000:1.0:1789683481.119889:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835426432 00000100:00100000:1.0:1789683481.120627:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835426048 00000100:00100000:1.0:1789683481.120632:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835426048 00000100:00100000:1.0:1789683481.120646:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835426304 00000100:00100000:1.0:1789683481.120649:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835426304 00000100:00100000:1.0:1789683481.120665:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 265 00000100:00100000:1.0:1789683481.120673:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835426176:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683481.120713:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835426176:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 42us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683481.120720:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 265 00000100:00100000:1.0:1789683481.120732:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 266 00000100:00100000:1.0:1789683481.120737:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835426432:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683481.120758:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835426432:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 21us (1533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683481.120764:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 266 00000100:00100000:1.0:1789683481.120775:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 267 00000100:00100000:1.0:1789683481.120811:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835426048:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683481.120836:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835426048:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 28us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683481.120842:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 267 00000100:00100000:1.0:1789683481.120854:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 268 00000100:00100000:1.0:1789683481.120859:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835426304:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683481.120881:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835426304:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 22us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683481.120887:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 268 00000100:00080000:1.0:1789683481.121308:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683481.121313:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683481.189630:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683481.189653:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f852e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850200704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683481.189728:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683481.189809:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850200704 00000100:00100000:3.0:1789683481.189817:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850200704 00000100:00100000:3.0:1789683481.189864:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789683481.189873:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850200704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789683481.189908:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789683481.189953:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850200704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683481.189972:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789683481.190020:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f852e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850200704:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789683481.631721:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683481.695197:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683481.695221:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850200832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683481.695321:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683481.695765:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850200832 00000100:00100000:2.0:1789683481.695774:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850200832 00000100:00100000:2.0:1789683481.695866:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789683481.695877:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850200832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789683481.695907:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683481.700648:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850200832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4763us (5317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683481.700681:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789683481.700771:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850200832:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789683481.701091:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1789683481.706075:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec036ece-1720-411a-849c-c978dbb41f8a 00000020:00000080:3.0:1789683481.706087:0:8433:0:(genops.c:885:class_export_put()) final put ffff9f0e83d4c000/ec036ece-1720-411a-849c-c978dbb41f8a 00000020:00000080:2.0:1789683481.706183:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83d4c000/ec036ece-1720-411a-849c-c978dbb41f8a for lustre-OST0000 00000020:00000080:2.0:1789683481.706240:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e83d4a000 for lustre-OST0000 00000100:00100000:1.0:1789683482.207350:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f852e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850200960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683482.207434:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683482.207564:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850200960 00000100:00100000:3.0:1789683482.207573:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850200960 00000100:00100000:3.0:1789683482.207621:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789683482.207632:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850200960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789683482.207665:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789683482.207722:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850200960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683482.207730:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789683482.207917:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f852e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850200960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683482.208484:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683482.208497:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f852e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850201088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683482.208531:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683482.208616:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850201088 00000100:00100000:3.0:1789683482.208621:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850201088 00000100:00100000:3.0:1789683482.208673:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789683482.208682:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850201088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683482.208698:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683482.208733:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850201088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683482.208740:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1789683482.208865:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683482.208947:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f852e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850201088:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789683482.658047:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789683482.658982:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789683482.662545:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683483.679280:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683483.743273:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850201216:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789683483.743358:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683483.743634:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850201216 00000100:00100000:2.0:1789683483.743644:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850201216 00000100:00100000:2.0:1789683483.743710:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789683483.743726:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850201216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789683483.743756:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683483.743833:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850201216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683483.743840:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1789683483.744078:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789683483.744109:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc14ae680 x1876618850201216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683483.744128:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850201216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683484.255709:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850201472:0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.255812:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683484.255868:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850201984:0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.255891:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683484.256069:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850201600:0@lo:400:kworker.0 00000100:00100000:2.0:1789683484.256105:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683484.256164:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850201600 00000100:00100000:2.0:1789683484.256171:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850201600 00000100:00100000:2.0:1789683484.256223:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789683484.256232:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850201600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683484.256422:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850201600:12345-0@lo:400:kworker.0 Request processed in 191us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683484.256441:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789683484.256525:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850201344:0@lo:400:kworker.0 00000100:00100000:3.0:1789683484.256565:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683484.256642:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850202496:0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.256677:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683484.256705:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850201472 00000100:00100000:1.0:1789683484.256710:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850201472 00000100:00100000:1.0:1789683484.256743:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850201984 00000100:00100000:1.0:1789683484.256747:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850201984 00000100:00100000:1.0:1789683484.256769:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850202496 00000100:00100000:1.0:1789683484.256772:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850202496 00000100:00100000:1.0:1789683484.256808:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789683484.256815:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850201472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.256852:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850201472:12345-0@lo:400:kworker.0 Request processed in 38us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683484.256859:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789683484.256873:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789683484.256880:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850201984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683484.257092:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850201344 00000100:00100000:2.0:1789683484.257097:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850201344 00000100:00100000:2.0:1789683484.257126:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1789683484.257133:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850201344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683484.257182:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850201344:12345-0@lo:400:kworker.0 Request processed in 50us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683484.257189:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1789683484.257311:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850201600:0@lo:400:kworker.0 00000100:00100000:3.0:1789683484.257321:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850202112:0@lo:400:kworker.0 00000100:00100000:3.0:1789683484.257355:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683484.257371:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850202624:0@lo:400:kworker.0 00000100:00100000:3.0:1789683484.257389:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683484.257415:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683484.257421:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc14ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850203008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683484.257454:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683484.257609:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850201728:0@lo:400:kworker.0 00000100:00100000:0.0:1789683484.257639:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683484.257654:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850202240:0@lo:400:kworker.0 00000100:00100000:0.0:1789683484.257677:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683484.257704:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850202752:0@lo:400:kworker.0 00000100:00100000:0.0:1789683484.257724:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789683484.257752:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683484.258096:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850203008 00000100:00100000:2.0:1789683484.258102:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850203008 00000100:00100000:2.0:1789683484.258152:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789683484.258160:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850203008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683484.258178:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683484.258220:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850203008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683484.258225:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789683484.258244:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850202240 00000100:00100000:2.0:1789683484.258248:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850202240 00000100:00100000:1.0:1789683484.259162:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850201984:12345-0@lo:400:kworker.0 Request processed in 27us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683484.259178:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789683484.259204:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850202112 00000100:00100000:1.0:1789683484.259209:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850202112 00000100:00100000:1.0:1789683484.259231:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850202624 00000100:00100000:1.0:1789683484.259234:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850202624 00000100:00100000:1.0:1789683484.259247:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850201728 00000100:00100000:1.0:1789683484.259250:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850201728 00000100:00100000:1.0:1789683484.259265:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789683484.260129:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850202752 00000100:00100000:2.0:1789683484.260139:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850202752 00000100:00100000:2.0:1789683484.260181:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789683484.260190:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850202240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.260387:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850202496:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789683484.260479:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683484.260484:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683484.260487:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683484.260590:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789683484.260601:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850202752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683484.270770:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789683484.270826:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850202112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683484.270953:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850202112:12345-0@lo:400:kworker.0 Request processed in 169us (13597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683484.270961:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789683484.270990:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789683484.270998:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850202624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683484.271040:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850202624:12345-0@lo:400:kworker.0 Request processed in 44us (13650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683484.271060:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789683484.271075:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789683484.271082:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850201728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683484.271114:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850201728:12345-0@lo:400:kworker.0 Request processed in 34us (13475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683484.271118:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789683484.275243:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850202496:12345-0@lo:400:kworker.0 Request processed in 4622us (8326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683484.275285:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789683484.275413:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850202496:0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.275507:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850201472:0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.275518:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850201984:0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.275596:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850201344:0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.275607:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850201856:0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.275672:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683484.275710:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850202368:0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.275735:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683484.275752:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850202880:0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.275773:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683484.275826:0:8676:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789683484.275834:0:8676:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00080000:1.0:1789683484.275870:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc14ace00 x1876618850203008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683484.275889:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc14ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850203008:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789683484.275901:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83fc4000 x1876618850202112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683484.276008:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850202112:0@lo:400:kworker.0 00010000:00080000:1.0:1789683484.276035:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83fc7b80 x1876618850202624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683484.276044:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850202624:0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.276080:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850201856 00000100:00100000:1.0:1789683484.276094:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850201856 00000100:00100000:1.0:1789683484.276134:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789683484.276142:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850201856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.276202:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850201856:12345-0@lo:400:kworker.0 Request processed in 61us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683484.276209:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789683484.276235:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850201856:0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.276371:0:8439:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789683484.276380:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850202368 00000100:00100000:1.0:1789683484.276383:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850202368 00000100:00100000:1.0:1789683484.276413:0:8439:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789683484.276418:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850202880 00000100:00100000:1.0:1789683484.276420:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850202880 00000100:00100000:1.0:1789683484.276444:0:8439:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789683484.276451:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789683484.276457:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850202368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.276493:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850202368:12345-0@lo:400:kworker.0 Request processed in 37us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683484.276499:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789683484.276510:0:8439:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789683484.276516:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789683484.276521:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850202880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.276548:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850202880:12345-0@lo:400:kworker.0 Request processed in 27us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683484.276553:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789683484.276577:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850202368:0@lo:400:kworker.0 00010000:00080000:1.0:1789683484.276586:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83fc5c00 x1876618850202880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683484.276600:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850202880:0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.276631:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850201728:0@lo:400:kworker.0 00000100:00100000:1.0:1789683484.276642:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850202240:0@lo:400:kworker.0 00000100:00080000:1.0:1789683484.276665:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683484.277833:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850202240:12345-0@lo:400:kworker.0 Request processed in 17636us (20146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683484.277846:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789683484.278219:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850202752:12345-0@lo:400:kworker.0 Request processed in 17620us (20492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683484.278228:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:1.0:1789683484.281777:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83fc4a80 x1876618850202752/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683484.281837:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850202752:0@lo:400:kworker.0 00010000:00010000:1.0:1789683484.703696:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683485.731106:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789683486.092388:0:14067:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 18:18:04 (1789683484) 00000100:00100000:2.0:1789683486.234085:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683486.234129:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683486.234149:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683486.234176:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683486.234207:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683486.236075:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835426816 00000100:00100000:2.0:1789683486.236091:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835426816 00000100:00100000:2.0:1789683486.236177:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835427072 00000100:00100000:2.0:1789683486.236181:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835427072 00000100:00100000:2.0:1789683486.236197:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835426688 00000100:00100000:2.0:1789683486.236200:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835426688 00000100:00100000:2.0:1789683486.236212:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835426944 00000100:00100000:2.0:1789683486.236214:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835426944 00000100:00100000:2.0:1789683486.236233:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 275 00000100:00100000:2.0:1789683486.236243:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835426816:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683486.236338:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835426816:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 96us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683486.236346:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 275 00000100:00100000:2.0:1789683486.236364:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 276 00000100:00100000:2.0:1789683486.236371:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2404:x1876618835427072:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683486.236407:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2404:x1876618835427072:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 36us (2256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683486.236413:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 276 00000100:00100000:2.0:1789683486.236427:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 277 00000100:00100000:2.0:1789683486.236433:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835426688:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683486.236458:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835426688:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 26us (2292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683486.236465:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 277 00000100:00100000:2.0:1789683486.236475:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 278 00000100:00100000:2.0:1789683486.236481:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2404:x1876618835426944:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683486.236501:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2404:x1876618835426944:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 21us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683486.236516:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 278 00000100:00080000:2.0:1789683486.236534:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683486.236538:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789683486.237749:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835426560 00000100:00100000:0.0:1789683486.237760:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835426560 00000100:00100000:0.0:1789683486.237832:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 383 00000100:00100000:0.0:1789683486.237841:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:2404:x1876618835426560:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683486.237893:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:2404:x1876618835426560:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 54us (3819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683486.237900:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 383 00000100:00100000:1.0:1789683486.304461:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f852ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850203136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683486.304536:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683486.305323:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850203136 00000100:00100000:3.0:1789683486.305333:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850203136 00000100:00100000:3.0:1789683486.305380:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789683486.305401:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850203136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789683486.305435:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789683486.305537:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850203136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683486.305544:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789683486.305882:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f852ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850203136:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789683486.751282:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683486.815208:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850203264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683486.815284:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683486.815467:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850203264 00000100:00100000:3.0:1789683486.815477:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850203264 00000100:00100000:3.0:1789683486.815542:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789683486.815553:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850203264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789683486.815583:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683486.815632:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850203264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683486.815658:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1789683486.816283:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683486.816330:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850203264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683487.327210:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683487.327239:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850203392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683487.327310:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683487.327769:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850203392 00000100:00100000:1.0:1789683487.327806:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850203392 00000100:00100000:1.0:1789683487.327864:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789683487.327874:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850203392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683487.327909:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789683487.327958:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850203392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683487.327981:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789683487.328027:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850203392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683487.328387:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683487.328399:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f852ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850203520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683487.328601:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683487.332767:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850203520 00000100:00100000:1.0:1789683487.332820:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850203520 00000100:00100000:1.0:1789683487.333125:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789683487.333140:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850203520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683487.333173:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683487.333268:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850203520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (4666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683487.333275:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1789683487.334442:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683487.334533:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f852ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850203520:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789683487.776049:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683487.801044:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683487.801208:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835427200 00000100:00100000:1.0:1789683487.801219:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835427200 00000100:00100000:1.0:1789683487.801281:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 40 00000100:00100000:1.0:1789683487.801291:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:11074:x1876618835427200:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789683487.801323:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683487.804762:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889915 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc51a expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683487.806579:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88991c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683487.806604:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88991c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683487.806620:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88991c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683487.806686:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789683487.806703:0:12533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789683487.806744:0:12533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88991c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683487.806777:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889915 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc51a expref: 7 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683487.806814:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88991c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc51a expref: 6 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683487.809868:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fb8504000) 00010000:00010000:1.0:1789683487.809878:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683487.809885:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dbc00, rc 0) 00000100:00100000:1.0:1789683487.810268:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+6:11074:x1876618835427200:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 8971us (9227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683487.810278:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 40 00000100:00100000:0.0:1789683487.825815:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683487.826029:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835427328 00000100:00100000:2.0:1789683487.826041:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835427328 00000100:00100000:2.0:1789683487.826113:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00100000:2.0:1789683487.826124:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:11075:x1876618835427328:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683487.826148:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683487.826170:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889923 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc521 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826239:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88992a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826254:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88992a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826267:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88992a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826282:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889931 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826288:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889931 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826294:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889931 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826407:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b889938 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826416:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b889938 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826424:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b889938 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683487.826470:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789683487.826474:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683487.826499:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b889938 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826511:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88992a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826519:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88992a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826526:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88992a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826533:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683487.826538:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88992a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826547:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88992a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826559:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fb8504000) 00010000:00010000:2.0:1789683487.826568:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683487.826574:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88992a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826580:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88992a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826597:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889931 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826603:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889931 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826608:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889931 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826613:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683487.826616:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889931 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826621:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889931 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826629:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9f0f83e0b600) 00010000:00010000:2.0:1789683487.826631:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683487.826634:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889931 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826639:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889931 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826682:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889923 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc521 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826711:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b889938 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc521 expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683487.826718:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f0f83e0b400) 00010000:00010000:2.0:1789683487.826720:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683487.826723:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30000, rc 0) 00000100:00100000:2.0:1789683487.826858:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+7:11075:x1876618835427328:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 735us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683487.826865:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00100000:2.0:1789683487.832154:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683487.832254:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835427456 00000100:00100000:3.0:1789683487.832267:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835427456 00000100:00100000:3.0:1789683487.832342:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:3.0:1789683487.832354:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ec036ece-1720-411a-849c-c978dbb41f8a+7:11075:x1876618835427456:12345-192.168.201.50@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789683487.832478:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ec036ece-1720-411a-849c-c978dbb41f8a+7:11075:x1876618835427456:12345-192.168.201.50@tcp:900:lhsmtool_posix.0 Request processed in 125us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683487.832487:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:2.0:1789683487.841541:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683487.843176:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835427712 00000100:00100000:1.0:1789683487.843189:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835427712 00000100:00100000:0.0:1789683487.843380:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 42 00000100:00100000:0.0:1789683487.843400:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+7:11075:x1876618835427712:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683487.843422:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683487.843458:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b88993f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc528 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.843534:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889946 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.843549:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889946 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.843561:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889946 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.843624:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88994d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.843633:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88994d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.843639:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88994d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.844126:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c200/0xcf8485587b889954 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.844135:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c200/0xcf8485587b889954 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.844143:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c200/0xcf8485587b889954 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683487.844153:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789683487.844236:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889946 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.844254:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889946 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.844260:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889946 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.844266:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683487.844270:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889946 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.844278:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889946 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.844289:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f0f83e0b400) 00010000:00010000:0.0:1789683487.844292:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683487.844309:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889946 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.844316:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889946 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.844328:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88994d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.844334:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88994d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.844340:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88994d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.844344:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454dc00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683487.844353:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88994d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.844369:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88994d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.844379:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f0f854c2300) 00010000:00010000:0.0:1789683487.844381:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683487.844384:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88994d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.844457:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88994d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.845029:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b88993f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc528 expref: 10 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.845046:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c200/0xcf8485587b889954 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc528 expref: 9 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683487.845053:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0f854c2c00) 00010000:00010000:0.0:1789683487.845056:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683487.845058:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454c200, rc 0) 00000100:00100000:0.0:1789683487.845272:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+9:11075:x1876618835427712:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 1881us (3742us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789683487.845281:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 42 00000100:00100000:0.0:1789683487.859640:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683487.860275:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835427840 00000100:00100000:1.0:1789683487.860289:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835427840 00000100:00100000:1.0:1789683487.860375:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:1.0:1789683487.860386:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+9:11075:x1876618835427840:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789683487.860524:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+9:11075:x1876618835427840:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 Request processed in 139us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683487.860532:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:3.0:1789683487.864103:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683487.864218:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835427968 00000100:00100000:1.0:1789683487.864229:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835427968 00000100:00100000:1.0:1789683487.864356:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 44 00000100:00100000:1.0:1789683487.864379:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:11075:x1876618835427968:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789683487.868163:0:6522:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3716us 00000100:00100000:1.0:1789683487.903816:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:11075:x1876618835427968:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 Request processed in 39428us (39712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683487.903835:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 44 00010000:00010000:2.0:1789683488.801683:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789683488.803417:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789683488.806585:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789683488.867160:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683488.867183:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850203648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683488.867249:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683488.867318:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850203648 00000100:00100000:2.0:1789683488.867326:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850203648 00000100:00100000:2.0:1789683488.867386:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789683488.867395:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850203648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789683488.867426:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683488.867481:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850203648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683488.867488:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:2.0:1789683488.867616:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e82517b80 x1876618850203648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683488.867659:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850203648:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789683488.868086:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683489.376429:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683489.376456:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850203776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683489.376556:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683489.376630:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850203776 00000100:00100000:0.0:1789683489.376650:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850203776 00000100:00100000:0.0:1789683489.376719:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789683489.376729:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850203776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683489.376752:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683489.376836:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850203776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683489.376843:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1789683489.376864:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789683489.376898:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7a41f80 x1876618850203776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683489.376918:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850203776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683489.377266:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f852ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850204032:0@lo:400:kworker.0 00000100:00100000:3.0:1789683489.377301:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683489.377320:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f852eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850204544:0@lo:400:kworker.0 00000100:00100000:3.0:1789683489.377351:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683489.377368:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850205056:0@lo:400:kworker.0 00000100:00100000:3.0:1789683489.377389:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683489.377412:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789683489.377419:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f852e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850204160:0@lo:400:kworker.0 00000100:00100000:3.0:1789683489.377455:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683489.377471:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850204672:0@lo:400:kworker.0 00000100:00100000:3.0:1789683489.377491:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683489.377505:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850205184:0@lo:400:kworker.0 00000100:00100000:3.0:1789683489.377524:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683489.380555:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850204032 00000100:00100000:0.0:1789683489.380571:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850204032 00000100:00100000:0.0:1789683489.380618:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850204544 00000100:00100000:0.0:1789683489.380622:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850204544 00000100:00100000:0.0:1789683489.380662:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850205056 00000100:00100000:0.0:1789683489.380666:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850205056 00000100:00100000:0.0:1789683489.380678:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850204672 00000100:00100000:0.0:1789683489.380681:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850204672 00000100:00100000:0.0:1789683489.380691:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850205184 00000100:00100000:0.0:1789683489.380694:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850205184 00000100:00100000:0.0:1789683489.380710:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789683489.380719:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850204032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.380836:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850204032:12345-0@lo:400:kworker.0 Request processed in 118us (3534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683489.380843:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789683489.380869:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789683489.380875:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850204544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.380907:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850204544:12345-0@lo:400:kworker.0 Request processed in 33us (3555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683489.380913:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789683489.380925:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789683489.380931:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850205056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.380959:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850205056:12345-0@lo:400:kworker.0 Request processed in 28us (3569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683489.380964:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789683489.380975:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789683489.380981:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850204672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.381009:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850204672:12345-0@lo:400:kworker.0 Request processed in 28us (3517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683489.381015:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789683489.381025:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789683489.381032:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850205184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.381061:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850205184:12345-0@lo:400:kworker.0 Request processed in 31us (3536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683489.381068:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00010000:00080000:0.0:1789683489.381134:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7a24000 x1876618850204672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683489.381152:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850204672:0@lo:400:kworker.0 00010000:00080000:0.0:1789683489.381167:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7a25f80 x1876618850205184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683489.381189:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850205184:0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.381204:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f852ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850204032:0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.381214:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f852eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850204544:0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.381225:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850205056:0@lo:400:kworker.0 00000100:00080000:0.0:1789683489.381265:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683489.381269:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683489.381283:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f852e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850203904:0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.381325:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683489.381374:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f852ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850204416:0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.381400:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683489.381421:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850204928:0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.381445:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683489.381466:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789683489.381474:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f852e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850204288:0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.381497:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683489.381514:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850204800:0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.381533:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683489.381548:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850205312:0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.381566:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683489.381591:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850204160 00000100:00100000:0.0:1789683489.381597:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850204160 00000100:00100000:0.0:1789683489.381624:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850204416 00000100:00100000:0.0:1789683489.381627:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850204416 00000100:00100000:0.0:1789683489.381652:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789683489.381660:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f89081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850204160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.381701:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f89081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850204160:12345-0@lo:400:kworker.0 Request processed in 42us (4246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683489.381707:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789683489.381720:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789683489.381725:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850204416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.381753:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850204416:12345-0@lo:400:kworker.0 Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683489.381759:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789683489.381819:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f852e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850204160:0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.381839:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850204288 00000100:00100000:0.0:1789683489.381842:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850204288 00000100:00100000:0.0:1789683489.381858:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789683489.381864:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850204288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.381893:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850204288:12345-0@lo:400:kworker.0 Request processed in 29us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683489.381899:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789683489.381923:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f852e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850204288:0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.381933:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f852ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850204416:0@lo:400:kworker.0 00000100:00100000:1.0:1789683489.382447:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850204928 00000100:00100000:1.0:1789683489.382454:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850204928 00000100:00100000:1.0:1789683489.382491:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850204800 00000100:00100000:1.0:1789683489.382495:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850204800 00000100:00100000:1.0:1789683489.382517:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850205312 00000100:00100000:1.0:1789683489.382520:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850205312 00000100:00100000:1.0:1789683489.382537:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789683489.382544:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850204928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683489.382593:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850204928:12345-0@lo:400:kworker.0 Request processed in 50us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683489.382600:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789683489.382615:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789683489.382621:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850204800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683489.382660:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850204800:12345-0@lo:400:kworker.0 Request processed in 39us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683489.382665:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789683489.382677:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789683489.382682:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850205312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683489.382710:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850205312:12345-0@lo:400:kworker.0 Request processed in 28us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683489.382716:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789683489.383001:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850203904 00000100:00100000:2.0:1789683489.383006:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850203904 00000100:00100000:2.0:1789683489.383036:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1789683489.383043:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850203904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683489.383080:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850203904:12345-0@lo:400:kworker.0 Request processed in 38us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683489.383086:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00080000:0.0:1789683489.383318:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683489.383360:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850204800:0@lo:400:kworker.0 00010000:00080000:0.0:1789683489.383378:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7a25880 x1876618850205312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683489.383401:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850205312:0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.383413:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f852e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850203904:0@lo:400:kworker.0 00000100:00100000:0.0:1789683489.383423:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850204928:0@lo:400:kworker.0 00010000:00010000:0.0:1789683489.823712:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683490.026053:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683490.026126:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835428096 00000100:00100000:0.0:1789683490.026137:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835428096 00000100:00100000:0.0:1789683490.026222:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 45 00000100:00100000:0.0:1789683490.026233:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+9:11117:x1876618835428096:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789683490.026257:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683490.026277:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c800/0xcf8485587b889962 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc52f expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026360:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889969 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026376:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889969 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026389:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889969 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026403:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889970 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026410:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889970 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026417:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889970 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026481:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889969 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026489:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889969 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026495:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889969 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026501:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454da00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683490.026506:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889969 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026514:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889969 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026526:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fb8504000) 00010000:00010000:0.0:1789683490.026529:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683490.026533:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889969 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026539:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889969 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026549:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889970 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026554:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889970 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026560:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889970 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026570:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683490.026573:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889970 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026579:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889970 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026586:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f0f854c2300) 00010000:00010000:0.0:1789683490.026588:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683490.026591:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889970 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026596:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889970 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026635:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c800/0xcf8485587b889962 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc52f expref: 10 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026645:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fb8504000) 00010000:00010000:0.0:1789683490.026647:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683490.026650:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c800/0xcf8485587b889962 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc52f expref: 10 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.026659:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454c800, rc 0) 00000100:00100000:0.0:1789683490.026717:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+9:11117:x1876618835428096:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 486us (674us total) trans 0 rc 301/301 00000100:00100000:0.0:1789683490.026724:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 45 00000100:00080000:1.0:1789683490.027259:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683490.038397:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683490.038477:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835428352 00000100:00100000:3.0:1789683490.038487:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835428352 00000100:00100000:3.0:1789683490.038549:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 46 00000100:00100000:3.0:1789683490.038560:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+9:11117:x1876618835428352:12345-192.168.201.50@tcp:36:lfs.0 00010000:00010000:3.0:1789683490.038631:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683490.038659:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88991c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc51a expref: 9 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.038678:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fb8504000) 00010000:00010000:3.0:1789683490.038688:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683490.038747:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889977 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.038761:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889977 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.038771:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889977 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.039009:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b88997e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.039019:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b88997e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.039043:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b88997e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.039775:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889985 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.039902:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.039910:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683490.039927:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078328f0e reply state 0000000034750c74 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.039937:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889985 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.039944:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:3.0:1789683490.039947:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789683490.039949:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789683490.039954:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789683490.039960:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889977 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.039966:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889977 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.039973:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889977 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.039978:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683490.039989:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889977 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.039997:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889977 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.040007:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e826a2500) 00010000:00010000:3.0:1789683490.040009:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683490.040012:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889977 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.040018:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889977 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683490.040035:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078328f0e reply state 0000000034750c74 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b88997e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.040044:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b88997e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.040050:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f0e826a2a00) 00010000:00010000:3.0:1789683490.040052:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789683490.040055:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789683490.040205:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+10:11117:x1876618835428352:12345-192.168.201.50@tcp:36:lfs.0 Request processed in 1645us (1817us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789683490.040213:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 46 00000100:00100000:3.0:1789683490.156049:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683490.156906:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835428480 00000100:00100000:3.0:1789683490.156920:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835428480 00000100:00100000:3.0:1789683490.156990:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:3.0:1789683490.157001:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+10:11126:x1876618835428480:12345-192.168.201.50@tcp:101:lctl.0 00010000:00010000:3.0:1789683490.157044:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683490.157072:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b88998c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc536 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.157142:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b889993 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.157158:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b889993 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.157172:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b889993 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683490.157218:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789683490.157222:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789683490.157259:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b889993 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.157284:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b88998c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc536 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.157302:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b889993 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc536 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.157310:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e826a2500) 00010000:00010000:3.0:1789683490.157313:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789683490.157316:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176c00, rc 0) 00000100:00100000:3.0:1789683490.157388:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+11:11126:x1876618835428480:12345-192.168.201.50@tcp:101:lctl.0 Request processed in 389us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683490.157395:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:1.0:1789683490.213316:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683490.214924:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835428608 00000100:00100000:2.0:1789683490.214938:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835428608 00000100:00100000:2.0:1789683490.215012:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:2.0:1789683490.215024:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+11:11132:x1876618835428608:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683490.215047:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683490.215072:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88999a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc53d expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215143:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b8899a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215160:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b8899a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215172:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b8899a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215183:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b8899a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215205:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b8899a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215210:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b8899a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215277:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b8899af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215282:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b8899af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215286:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b8899af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683490.215342:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789683490.215346:0:12533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683490.215385:0:12533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b8899af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215397:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b8899a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215404:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b8899a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215411:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b8899a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215418:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683490.215422:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b8899a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215435:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b8899a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215446:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e826a2500) 00010000:00010000:2.0:1789683490.215467:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683490.215472:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b8899a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215477:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b8899a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215487:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b8899a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215490:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b8899a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215494:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b8899a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215497:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683490.215499:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b8899a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215502:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b8899a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215506:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f0e826a2a00) 00010000:00010000:2.0:1789683490.215507:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683490.215509:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b8899a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215519:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b8899a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215538:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88999a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc53d expref: 13 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215546:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b8899af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc53d expref: 12 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.215551:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:2.0:1789683490.215552:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789683490.215554:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30c00, rc 0) 00000100:00100000:2.0:1789683490.215629:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+12:11132:x1876618835428608:12345-192.168.201.50@tcp:101:bash.0 Request processed in 609us (2321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683490.215634:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:3.0:1789683490.217864:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683490.217920:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835428864 00000100:00100000:1.0:1789683490.217930:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835428864 00000100:00100000:1.0:1789683490.218043:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 49 00000100:00100000:1.0:1789683490.218054:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+12:11132:x1876618835428864:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:1.0:1789683490.218075:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683490.218094:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b8899b6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc544 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.218207:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b8899bd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.218224:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b8899bd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.218235:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b8899bd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.218311:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b8899c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.218329:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b8899c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.218337:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b8899c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789683490.218694:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789683490.218883:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8899cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.218892:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8899cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.218899:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8899cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.218933:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b8899bd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.218942:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b8899bd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.218949:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b8899bd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.218955:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837daa00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683490.218959:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b8899bd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.218966:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b8899bd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.218977:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:1.0:1789683490.218980:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683490.218986:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b8899bd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.218992:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b8899bd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789683490.219016:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fae7918f reply state 0000000009c88954 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b8899c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.219026:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b8899c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.219032:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0fb8504e00) 00010000:00010000:1.0:1789683490.219034:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789683490.219036:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789683490.219063:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b8899b6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc544 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.219076:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8899cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc544 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.219083:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504500) 00010000:00010000:1.0:1789683490.219085:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683490.219087:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dbc00, rc 0) 00000100:00100000:1.0:1789683490.219157:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+15:11132:x1876618835428864:12345-192.168.201.50@tcp:101:bash.0 Request processed in 1104us (1301us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789683490.219164:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 49 00000100:00100000:0.0:1789683490.223856:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683490.223910:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835428992 00000100:00100000:2.0:1789683490.223920:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835428992 00000100:00100000:2.0:1789683490.223968:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:2.0:1789683490.223977:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1876618835428992:12345-192.168.201.50@tcp:8:bash.0 00010000:00080000:2.0:1789683490.224012:0:8439:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp t0 exp 0000000000000000 cur 404 last 0 00000020:00000080:2.0:1789683490.224044:0:8439:0:(genops.c:1384:class_connect()) connect: client ec036ece-1720-411a-849c-c978dbb41f8a, cookie 0xcf8485587b8899d9 00002000:00100000:2.0:1789683490.224058:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ec036ece-1720-411a-849c-c978dbb41f8a/ffff9f0e83e1b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789683490.224076:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:2.0:1789683490.224151:0:8439:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789683490.224179:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9f0e83e1a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683490.224300:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:2401:x1876618835428992:12345-192.168.201.50@tcp:8:bash.0 Request processed in 314us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683490.224308:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:2.0:1789683490.227169:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683490.227336:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835429120 00000100:00100000:1.0:1789683490.227349:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835429120 00000100:00100000:1.0:1789683490.227434:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:1.0:1789683490.227446:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+6:0:x1876618835429120:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:1.0:1789683490.227466:0:14000:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683490.227492:0:14000:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b8899e0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc54b expref: -99 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789683490.227536:0:14000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789683490.227557:0:14000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1789683490.227562:0:14000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683490.227572:0:14000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b8899e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc54b expref: 7 pid: 14000 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.227594:0:14000:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b8899e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc54b expref: 7 pid: 14000 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.227607:0:14000:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dac00, rc 0) 00000100:00100000:1.0:1789683490.227675:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+7:0:x1876618835429120:12345-192.168.201.50@tcp:101:bash.0 Request processed in 231us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683490.227683:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00080000:0.0:1789683490.227757:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683490.237046:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683490.237421:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835429248 00000100:00100000:3.0:1789683490.237431:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835429248 00000100:00100000:0.0:1789683490.237692:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:0.0:1789683490.237703:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+7:11132:x1876618835429248:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789683490.237722:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683490.237742:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007205033b/0xcf8485587b8899e7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc552 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.237925:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b8899e0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc54b expref: 8 pid: 14000 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.237935:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683490.237940:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683490.237946:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007205033b/0xcf8485587b8899e7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc552 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.237994:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b8899e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc54b expref: 8 pid: 14000 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.238008:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b8899e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc54b expref: 8 pid: 14000 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683490.238022:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a41500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8440:1876618850205440:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789683490.238122:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8bb9ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683490.246300:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a41500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8440:1876618850205440:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683490.246352:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007205033b/0xcf8485587b8899e7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc552 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.246392:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d600, rc 0) 00000100:00100000:0.0:1789683490.246523:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+8:11132:x1876618835429248:12345-192.168.201.50@tcp:101:bash.0 Request processed in 8820us (9485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683490.246533:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:2.0:1789683490.257645:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683490.257751:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835429376 00000100:00100000:0.0:1789683490.257767:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835429376 00010000:00010000:0.0:1789683490.257935:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b8899e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc54b expref: 8 pid: 14000 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683490.257970:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:0.0:1789683490.258036:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb29fa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+8:2403:x1876618835429376:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683490.258052:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683490.258074:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b8899e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc54b expref: 8 pid: 14000 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.258086:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b8899e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc54b expref: 8 pid: 14000 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.258110:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b8899e0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc54b expref: 8 pid: 14000 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.258124:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683490.258128:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683490.258134:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007205033b/0xcf8485587b8899e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc552 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.258154:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007205033b/0xcf8485587b8899e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc552 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.258182:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007205033b/0xcf8485587b8899e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc552 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683490.258193:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a41500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6507:1876618850205568:192.168.201.50@tcp:105: 00000100:00100000:0.0:1789683490.258264:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8bb9ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683490.261969:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683490.262111:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a41500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6507:1876618850205568:192.168.201.50@tcp:105: 00010000:00010000:2.0:1789683490.262132:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683490.262179:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb29fa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:2403:x1876618835429376:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 4202us (4547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683490.262188:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:3.0:1789683490.264540:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835429632 00000100:00100000:3.0:1789683490.264558:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835429632 00000100:00100000:3.0:1789683490.264633:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:3.0:1789683490.264645:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+15:11132:x1876618835429632:12345-192.168.201.50@tcp:35:bash.0 00000100:00100000:3.0:1789683490.265306:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+16:11132:x1876618835429632:12345-192.168.201.50@tcp:35:bash.0 Request processed in 658us (3341us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789683490.265315:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:2.0:1789683490.360367:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683490.361467:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835429888 00000100:00100000:3.0:1789683490.361481:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835429888 00000100:00100000:3.0:1789683490.361914:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:3.0:1789683490.361927:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+16:11142:x1876618835429888:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789683490.361953:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683490.361974:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b8899ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc559 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683490.362084:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789683490.362184:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b8899ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc559 expref: 18 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.362200:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e826a2500) 00010000:00010000:3.0:1789683490.362203:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683490.362222:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b8899ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc559 expref: 18 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.362237:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6177400, rc 0) 00000100:00100000:3.0:1789683490.362302:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+17:11142:x1876618835429888:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 378us (1948us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1789683490.362309:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:0.0:1789683490.365383:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683490.365685:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835430144 00000100:00100000:1.0:1789683490.365696:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835430144 00000100:00100000:1.0:1789683490.365754:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:1.0:1789683490.365765:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+17:11142:x1876618835430144:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:1.0:1789683490.366296:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+18:11142:x1876618835430144:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 530us (923us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789683490.366305:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:1.0:1789683490.448891:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683490.449005:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835430272 00000100:00100000:2.0:1789683490.449018:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835430272 00000100:00100000:2.0:1789683490.449083:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 51 00000100:00100000:2.0:1789683490.449095:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+18:11148:x1876618835430272:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683490.449121:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683490.449143:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b8899fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc560 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.449211:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889a03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.449227:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889a03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.449240:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889a03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683490.449286:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789683490.449290:0:12533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683490.449312:0:12533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889a03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.449372:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b8899fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc560 expref: 20 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.449393:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889a03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc560 expref: 19 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.449403:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:2.0:1789683490.449406:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683490.449410:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30a00, rc 0) 00000100:00100000:2.0:1789683490.449865:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+19:11148:x1876618835430272:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 770us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683490.449874:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 51 00000100:00100000:2.0:1789683490.457690:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683490.457881:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835430528 00000100:00100000:1.0:1789683490.457894:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835430528 00000100:00100000:1.0:1789683490.457994:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:1.0:1789683490.458003:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+19:11148:x1876618835430528:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789683490.458027:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683490.458049:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889a0a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc567 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.458171:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889a11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.458185:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889a11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.458198:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889a11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683490.458210:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789683490.458312:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889a0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc567 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.458343:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889a11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc567 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.458353:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504500) 00010000:00010000:1.0:1789683490.458356:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683490.458359:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da800, rc 0) 00000100:00100000:1.0:1789683490.458431:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+21:11148:x1876618835430528:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 429us (750us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789683490.458439:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:1.0:1789683490.462894:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683490.463256:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835430784 00000100:00100000:3.0:1789683490.463269:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835430784 00000100:00100000:3.0:1789683490.463351:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:3.0:1789683490.463362:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+21:11148:x1876618835430784:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789683490.463386:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683490.463409:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889a1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc56e expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.463546:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889a26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.463564:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889a26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.463577:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889a26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683490.463591:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789683490.464165:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889a1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc56e expref: 24 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.464184:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889a26 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc56e expref: 23 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.464202:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504500) 00010000:00010000:3.0:1789683490.464205:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789683490.464209:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176a00, rc 0) 00000100:00100000:3.0:1789683490.464367:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+23:11148:x1876618835430784:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 1006us (1483us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789683490.464375:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:2.0:1789683490.466681:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683490.469220:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835430912 00000100:00100000:3.0:1789683490.469242:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835430912 00000100:00100000:3.0:1789683490.469357:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:3.0:1789683490.469368:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+23:2402:x1876618835430912:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683490.469384:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683490.469411:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889a11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc567 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.469434:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504500) 00010000:00010000:3.0:1789683490.469439:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683490.469528:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+22:2402:x1876618835430912:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 161us (2858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683490.469536:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:1.0:1789683490.479027:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683490.479110:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835431040 00000100:00100000:3.0:1789683490.479121:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835431040 00000100:00100000:3.0:1789683490.479185:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:3.0:1789683490.479198:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:2402:x1876618835431040:12345-192.168.201.50@tcp:1:lfs.0 00010000:00010000:3.0:1789683490.479250:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b889a34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.479287:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007205033b/0xcf8485587b8899e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc552 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.479296:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683490.479301:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683490.479305:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b889a34 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.479354:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007205033b/0xcf8485587b8899e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc552 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.479370:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007205033b/0xcf8485587b8899e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc552 expref: 7 pid: 8440 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683490.479386:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83d17480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1876618850205696:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789683490.479484:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc14f13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683490.481897:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83d17480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1876618850205696:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789683490.481929:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b889a34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683490.483839:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683490.484380:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835431168 00000100:00100000:3.0:1789683490.484391:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835431168 00002000:00100000:3.0:1789683490.484439:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9f0e83fc4e00 x1876618835431168/t0(0) o4->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:546/0 lens 504/0 e 0 to 0 dl 1789683501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789683490.484450:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e83fc4e00 with x1876618835431168 ext(0->12) 00010000:00010000:3.0:1789683490.484459:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007205033b/0xcf8485587b8899e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc552 expref: 8 pid: 8440 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.484476:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007205033b/0xcf8485587b8899e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc552 expref: 8 pid: 8440 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683490.484496:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f0e83fc4e00 00000100:00100000:3.0:1789683490.484533:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:3.0:1789683490.484543:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec036ece-1720-411a-849c-c978dbb41f8a+8:2402:x1876618835431168:12345-192.168.201.50@tcp:4:lfs.0 00000001:00100000:3.0:1789683490.487422:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec036ece-1720-411a-849c-c978dbb41f8a 00000100:00100000:1.0:1789683490.488117:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec036ece-1720-411a-849c-c978dbb41f8a+9:2402:x1876618835431168:12345-192.168.201.50@tcp:4:lfs.0 Request processed in 3568us (4280us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789683490.488134:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 0 00002000:00100000:1.0:1789683490.488146:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9f0e83fc4e00 x1876618835431168/t4294967300(0) o4->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:546/0 lens 504/448 e 0 to 0 dl 1789683501 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789683490.488157:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e83fc4e00 with x1876618835431168 ext(0->12) 00010000:00010000:1.0:1789683490.488167:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007205033b/0xcf8485587b8899e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc552 expref: 9 pid: 8440 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.488185:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007205033b/0xcf8485587b8899e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc552 expref: 9 pid: 8440 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789683490.488194:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f0e83fc4e00 00000100:00100000:3.0:1789683490.490505:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683490.490627:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835431296 00000100:00100000:0.0:1789683490.490639:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835431296 00010000:00010000:0.0:1789683490.490677:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007205033b/0xcf8485587b8899e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc552 expref: 9 pid: 8440 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683490.490721:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:0.0:1789683490.490731:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+9:2405:x1876618835431296:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683490.490745:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789683490.490762:0:6508:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789683490.490765:0:6508:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789683490 00002000:00010000:0.0:1789683490.490767:0:6508:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789683490 00002000:00010000:0.0:1789683490.490770:0:6508:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789683490 00002000:00010000:0.0:1789683490.490772:0:6508:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789683490.490819:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007205033b/0xcf8485587b8899e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc552 expref: 9 pid: 8440 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.490848:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007205033b/0xcf8485587b8899e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc552 expref: 9 pid: 8440 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.490870:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007205033b/0xcf8485587b8899e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc552 expref: 9 pid: 8440 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.490887:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789683490.490891:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789683490.490897:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b889a34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.490907:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b889a34 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.490929:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683490.490992:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+8:2405:x1876618835431296:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 262us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683490.491000:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 53 00010000:00010000:1.0:1789683490.491656:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b889a34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.491669:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b889a34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.491691:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b889a34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.491708:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b889a34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.491717:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b889a34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.491724:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683490.491728:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b889a34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.491736:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b889a34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.491749:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b889a34 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.491755:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b889a34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683490.491916:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:2402:x1876618835431040:12345-192.168.201.50@tcp:1:lfs.0 Request processed in 12719us (12898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683490.491925:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:3.0:1789683490.496005:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683490.496212:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835431552 00000100:00100000:2.0:1789683490.496223:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835431552 00000100:00100000:2.0:1789683490.496323:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:2.0:1789683490.496335:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+22:11148:x1876618835431552:12345-192.168.201.50@tcp:35:lfs.0 00000004:00010000:2.0:1789683490.496403:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889a26 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc56e expref: 22 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789683490.496648:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1789683490.496694:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789683490.497303:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1789683490.497358:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889a3b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.497392:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8899cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc544 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.497401:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889a3b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.497442:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8899cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc544 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683490.497732:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8899cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc544 expref: 26 pid: 6522 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683490.497749:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f1b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1876618850205824:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683490.497963:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e835a5300 going to sleep for 11 seconds 00000100:00100000:2.0:1789683490.502703:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683490.503046:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f1b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1876618850205824:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789683490.503078:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889a3b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683490.503333:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835431680 00000100:00100000:0.0:1789683490.503341:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835431680 00010000:00010000:0.0:1789683490.503380:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8899cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc544 expref: 27 pid: 6522 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683490.503448:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:0.0:1789683490.503473:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+27:2402:x1876618835431680:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683490.503505:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683490.503512:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8899cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc544 expref: 27 pid: 6522 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.503524:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8899cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc544 expref: 27 pid: 6522 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.503544:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b8899cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc544 expref: 27 pid: 6522 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.503558:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504500) 00010000:00010000:0.0:1789683490.503563:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889a3b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.503573:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889a3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.503580:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889a3b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.503612:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683490.503663:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+26:2402:x1876618835431680:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 191us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683490.503670:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 54 00010000:00010000:3.0:1789683490.503719:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889a3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.503727:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889a3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789683490.503871:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1789683490.503984:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1789683490.504097:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f85250a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876618850205952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789683490.504151:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683490.504181:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc14f1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683490.507820:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850205952 00000100:00100000:1.0:1789683490.507836:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850205952 00000100:00100000:1.0:1789683490.507914:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789683490.507937:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1876618850205952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789683490.508202:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1876618850205952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 266us (4049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683490.508210:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789683490.508478:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f85250a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876618850205952:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789683490.508700:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1789683490.508771:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f85250a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876618850206080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789683490.508846:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683490.508884:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc14f1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683490.509165:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850206080 00000100:00100000:1.0:1789683490.509171:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850206080 00000100:00100000:1.0:1789683490.509221:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789683490.509229:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1876618850206080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789683490.509375:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6524:x1876618850206080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 146us (528us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789683490.509382:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789683490.509476:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f85250a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876618850206080:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789683490.509517:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1789683490.509551:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889a3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.509562:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889a3b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.509570:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889a3b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.509577:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683490.509581:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889a3b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.509590:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889a3b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.509618:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504500) 00010000:00010000:3.0:1789683490.509621:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789683490.509626:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889a3b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.509632:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889a3b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789683490.509727:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789683490.509927:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1789683490.509939:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 404559154934ns, next at 405559152000ns, rc = 0 00000001:00080000:3.0:1789683490.509946:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1789683490.510059:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504500) 00010000:00010000:3.0:1789683490.510063:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789683490.510070:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889a26 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc56e expref: 30 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683490.510161:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+29:11148:x1876618835431552:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 13829us (14382us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1789683490.510168:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 8 00000020:00080000:3.0:1789683490.510172:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789683490.514086:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683490.514197:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835431808 00000100:00100000:1.0:1789683490.514208:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835431808 00000100:00100000:1.0:1789683490.514303:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:1.0:1789683490.514324:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+29:11148:x1876618835431808:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789683490.514350:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683490.514373:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889a42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc575 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.514438:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889a42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc575 expref: 30 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.514466:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889a42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc575 expref: 30 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.514485:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:1.0:1789683490.514489:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789683490.514504:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dac00, rc 0) 00000100:00100000:1.0:1789683490.514608:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+30:11148:x1876618835431808:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 295us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683490.514615:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:3.0:1789683490.517765:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683490.517946:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835432064 00000100:00100000:0.0:1789683490.517962:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835432064 00000100:00100000:0.0:1789683490.518048:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:0.0:1789683490.518058:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f867cdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+30:11148:x1876618835432064:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:0.0:1789683490.518372:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f867cdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+31:11148:x1876618835432064:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 315us (620us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789683490.518380:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:2.0:1789683490.600196:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683490.600304:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835432320 00000100:00100000:0.0:1789683490.600344:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835432320 00000100:00100000:0.0:1789683490.600421:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:0.0:1789683490.600432:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+31:11158:x1876618835432320:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789683490.600681:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683490.600705:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889a49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc57c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683490.600843:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789683490.600947:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889a49 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc57c expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.600962:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e826a2500) 00010000:00010000:0.0:1789683490.600966:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789683490.600971:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889a49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc57c expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.600986:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d600, rc 0) 00000100:00100000:0.0:1789683490.601091:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+32:11158:x1876618835432320:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 660us (906us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1789683490.601098:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:2.0:1789683490.612413:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683490.612572:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835432448 00000100:00100000:3.0:1789683490.612583:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835432448 00000100:00100000:3.0:1789683490.612768:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:3.0:1789683490.612941:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+32:11158:x1876618835432448:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:3.0:1789683490.613095:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889a57 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613117:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889a57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613131:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889a57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613142:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889a5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613148:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889a5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613154:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889a5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613335:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889a65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613345:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889a65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613351:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889a65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683490.613399:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889a65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613411:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889a57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613417:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889a57 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613424:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889a57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613430:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683490.613434:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889a57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613442:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889a57 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613527:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:3.0:1789683490.613532:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683490.613537:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889a57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613550:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889a57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613566:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889a5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613572:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889a5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613578:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889a5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613583:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683490.613587:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889a5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613592:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889a5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613746:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0fb8504e00) 00010000:00010000:3.0:1789683490.613749:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683490.613752:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889a5e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613758:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889a5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613769:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889a65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613943:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889a65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613957:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889a65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.613962:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683490.613966:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889a65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.614050:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889a65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.614061:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:3.0:1789683490.614064:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683490.614068:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889a65 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683490.614074:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889a65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683490.614229:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+32:11158:x1876618835432448:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 1289us (1821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683490.614239:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:2.0:1789683490.617571:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683490.617735:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835432704 00000100:00100000:0.0:1789683490.617746:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835432704 00000100:00100000:0.0:1789683490.617935:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:0.0:1789683490.617961:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+32:11158:x1876618835432704:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:0.0:1789683490.618197:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+33:11158:x1876618835432704:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 238us (638us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789683490.618205:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:2.0:1789683490.666616:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683490.667345:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835432960 00000100:00100000:1.0:1789683490.667357:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835432960 00000100:00100000:1.0:1789683490.667501:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:1.0:1789683490.667512:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+33:11161:x1876618835432960:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789683490.667538:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683490.667563:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b889a6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc583 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.667667:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889a73 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.667683:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889a73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.667696:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889a73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.667710:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889a7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.667716:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889a7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.667722:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889a7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.667878:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889a81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.667900:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889a81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.667907:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889a81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683490.667920:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789683490.668302:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889a73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.668323:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889a73 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.668331:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889a73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.668337:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dbc00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683490.668341:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889a73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.668348:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889a73 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.668359:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:1.0:1789683490.668362:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683490.668367:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889a73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.668373:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889a73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.668386:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889a7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.668400:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889a7a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.668406:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889a7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.668411:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837da800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683490.668414:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889a7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.668420:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889a7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.668427:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0fb8504e00) 00010000:00010000:1.0:1789683490.668430:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683490.668433:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889a7a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.668439:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889a7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.668500:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b889a6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc583 expref: 36 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.668517:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889a81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc583 expref: 35 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683490.668525:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:1.0:1789683490.668527:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683490.668537:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da200, rc 0) 00000100:00100000:1.0:1789683490.668714:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+35:11161:x1876618835432960:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 1203us (2120us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789683490.668723:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:3.0:1789683490.672666:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683490.672758:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835433088 00000100:00100000:0.0:1789683490.672770:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835433088 00000100:00100000:0.0:1789683490.672873:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:0.0:1789683490.672885:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+35:11161:x1876618835433088:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:0.0:1789683490.672965:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889a8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.673000:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889a8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.673014:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889a8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.673063:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889a8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.673073:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889a8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.673081:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889a8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.673088:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683490.673093:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889a8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.673125:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889a8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.673139:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:0.0:1789683490.673142:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789683490.673148:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889a8f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.673154:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889a8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683490.673261:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+35:11161:x1876618835433088:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 378us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683490.673268:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:2.0:1789683490.676308:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683490.676400:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835433344 00000100:00100000:3.0:1789683490.676411:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835433344 00000100:00100000:3.0:1789683490.676469:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:3.0:1789683490.676480:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+35:11161:x1876618835433344:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789683490.676757:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+36:11161:x1876618835433344:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 278us (464us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789683490.676810:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 11 00010000:00010000:0.0:1789683490.848906:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683490.964242:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683490.964384:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835433600 00000100:00100000:0.0:1789683490.964395:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835433600 00000100:00100000:0.0:1789683490.964471:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:0.0:1789683490.964482:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+36:11192:x1876618835433600:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:0.0:1789683490.964512:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683490.964540:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889a96 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc58a expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.965874:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b889a9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.965894:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b889a9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.965927:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b889a9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683490.965941:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789683490.966084:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889a96 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc58a expref: 39 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.966105:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b889a9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc58a expref: 38 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.966114:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:0.0:1789683490.966118:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683490.966121:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454cc00, rc 0) 00000100:00100000:0.0:1789683490.966259:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+38:11192:x1876618835433600:12345-192.168.201.50@tcp:101:cat.0 Request processed in 1778us (2026us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789683490.966268:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:1.0:1789683490.980497:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683490.980555:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683490.980733:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835433984 00000100:00100000:3.0:1789683490.980746:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835433984 00000100:00100000:3.0:1789683490.980838:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:3.0:1789683490.980849:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+38:11192:x1876618835433984:12345-192.168.201.50@tcp:35:cat.0 00000100:00100000:3.0:1789683490.981131:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+39:11192:x1876618835433984:12345-192.168.201.50@tcp:35:cat.0 Request processed in 283us (647us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1789683490.981139:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:0.0:1789683490.982211:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835433856 00000100:00100000:0.0:1789683490.982221:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835433856 00000100:00100000:0.0:1789683490.982280:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:0.0:1789683490.982300:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+39:2402:x1876618835433856:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683490.982322:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683490.982346:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b889a9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc58a expref: 39 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683490.982364:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:0.0:1789683490.982369:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683490.982648:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+38:2402:x1876618835433856:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 359us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683490.982657:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:1.0:1789683491.037922:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683491.038117:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835434240 00000100:00100000:2.0:1789683491.038129:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835434240 00000100:00100000:2.0:1789683491.038193:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:2.0:1789683491.038204:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+38:11198:x1876618835434240:12345-192.168.201.50@tcp:101:dd.0 00010000:00010000:2.0:1789683491.038230:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683491.038240:0:12533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789683491.038266:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889a03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc560 expref: 38 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.038287:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:2.0:1789683491.038292:0:12533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683491.038320:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889aab lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc591 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.038430:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889ab2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.038444:0:12533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889a81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc583 expref: 38 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.038467:0:12533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889ab2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.038515:0:12533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889a81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc583 expref: 38 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.038529:0:12533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889a81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc583 expref: 38 pid: 12533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683491.038542:0:12533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12533:1876618850206208:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683491.039458:0:12533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e835a5540 going to sleep for 11 seconds 00000100:00100000:3.0:1789683491.043506:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683491.043582:0:12533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12533:1876618850206208:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683491.043620:0:12533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889ab2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683491.043761:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835434368 00000100:00100000:0.0:1789683491.043774:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835434368 00010000:00010000:0.0:1789683491.043831:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889a81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc583 expref: 39 pid: 12533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683491.043867:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:0.0:1789683491.043876:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85252680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+39:2402:x1876618835434368:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683491.043893:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683491.043899:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889a81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc583 expref: 39 pid: 12533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.043911:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889a81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc583 expref: 39 pid: 12533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.043937:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889a81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc583 expref: 39 pid: 12533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.043952:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:0.0:1789683491.043957:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889ab2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.043977:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889ab2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.043985:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889ab2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.044011:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683491.044846:0:12533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889ab2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.044857:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889ab2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683491.044879:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789683491.045065:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889aab lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc591 expref: 40 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.045084:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889ab2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc591 expref: 39 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.045092:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:2.0:1789683491.045095:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789683491.045098:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30600, rc 0) 00000100:00100000:0.0:1789683491.046038:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85252680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+39:2402:x1876618835434368:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 2158us (2536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683491.046050:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:2.0:1789683491.046121:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+38:11198:x1876618835434240:12345-192.168.201.50@tcp:101:dd.0 Request processed in 7918us (8212us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789683491.046129:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:3.0:1789683491.049151:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683491.049633:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835434496 00000100:00100000:1.0:1789683491.049644:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835434496 00000100:00100000:1.0:1789683491.049714:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:1.0:1789683491.049727:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+38:11198:x1876618835434496:12345-192.168.201.50@tcp:101:dd.0 00010000:00010000:1.0:1789683491.049752:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683491.049812:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b889ac0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc598 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683491.049848:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b889ac7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683491.049864:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b889ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683491.049875:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b889ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683491.050360:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b889ac0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc598 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683491.050381:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b889ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc598 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683491.050402:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:1.0:1789683491.050405:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789683491.050410:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81391400, rc 0) 00000100:00100000:1.0:1789683491.050480:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+39:11198:x1876618835434496:12345-192.168.201.50@tcp:101:dd.0 Request processed in 756us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683491.050488:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:1.0:1789683491.057754:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683491.057924:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835434752 00000100:00100000:0.0:1789683491.057934:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835434752 00000100:00100000:0.0:1789683491.058076:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 62 00000100:00100000:0.0:1789683491.058087:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+39:11198:x1876618835434752:12345-192.168.201.50@tcp:36:dd.0 00010000:00010000:0.0:1789683491.058319:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889ace lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.058337:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889ace lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.058349:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889ace lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789683491.058391:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1789683491.058414:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d730931 reply state 0000000092606490 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889ace lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.058426:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889ace lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.058435:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:0.0:1789683491.058438:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789683491.058442:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789683491.058526:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+42:11198:x1876618835434752:12345-192.168.201.50@tcp:36:dd.0 Request processed in 440us (784us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1789683491.058547:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 62 00000020:00080000:0.0:1789683491.058552:0:8462:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789683491.350455:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683491.350509:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683491.350554:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683491.350602:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683491.350632:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683491.350716:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835435392 00000100:00100000:3.0:1789683491.350727:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835435392 00000100:00100000:3.0:1789683491.350835:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835435008 00000100:00100000:3.0:1789683491.350839:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835435008 00000100:00100000:3.0:1789683491.350867:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835435264 00000100:00100000:3.0:1789683491.350870:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835435264 00000100:00100000:3.0:1789683491.350892:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 285 00000100:00100000:3.0:1789683491.350903:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835435392:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683491.350981:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835435392:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 81us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683491.350989:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 285 00000100:00100000:3.0:1789683491.351007:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 286 00000100:00100000:3.0:1789683491.351013:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835435008:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683491.351053:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835435008:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 39us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683491.351074:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 286 00000100:00100000:3.0:1789683491.351087:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 287 00000100:00100000:3.0:1789683491.351094:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835435264:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683491.351121:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835435264:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 28us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683491.351128:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 287 00000100:00080000:0.0:1789683491.351246:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683491.351251:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789683491.351332:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835434880 00000100:00100000:2.0:1789683491.351337:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835434880 00000100:00100000:2.0:1789683491.351378:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 385 00000100:00100000:2.0:1789683491.351386:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:2403:x1876618835434880:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683491.351416:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:2403:x1876618835434880:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 31us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683491.351423:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 385 00000100:00100000:1.0:1789683491.352650:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835435136 00000100:00100000:1.0:1789683491.352664:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835435136 00000100:00100000:1.0:1789683491.352726:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 111 00000100:00100000:1.0:1789683491.352745:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+7:2403:x1876618835435136:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683491.352836:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+7:2403:x1876618835435136:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 102us (2326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683491.352843:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 111 00000100:00100000:3.0:1789683491.387122:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683491.387277:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835435520 00000100:00100000:0.0:1789683491.387290:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835435520 00000100:00100000:0.0:1789683491.387372:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:0.0:1789683491.387383:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+42:11212:x1876618835435520:12345-192.168.201.50@tcp:101:stat.0 00010000:00010000:0.0:1789683491.387413:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683491.387439:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889ad5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc59f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.387540:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889adc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.387558:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889adc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.387572:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889adc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.387584:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889ae3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.387613:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.387621:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.387717:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889aea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.387729:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889ab2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc591 expref: 43 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.387738:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889aea lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.387779:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889ab2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc591 expref: 43 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.387825:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889ab2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc591 expref: 43 pid: 12533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683491.387841:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f852ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850206336:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789683491.387961:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8bb9ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683491.394749:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683491.395016:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835435776 00000100:00100000:1.0:1789683491.395027:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835435776 00000100:00100000:1.0:1789683491.395093:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:1.0:1789683491.395103:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+44:6173:x1876618835435776:12345-192.168.201.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789683491.395518:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+45:6173:x1876618835435776:12345-192.168.201.50@tcp:35:ldlm_bl.0 Request processed in 413us (775us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789683491.395527:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:0.0:1789683491.397196:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f852ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850206336:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683491.397229:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889aea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683491.400486:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683491.400607:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835435904 00000100:00100000:2.0:1789683491.400619:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835435904 00010000:00010000:2.0:1789683491.400666:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889ab2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc591 expref: 45 pid: 12533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683491.400715:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:2.0:1789683491.400725:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+45:2403:x1876618835435904:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683491.400741:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683491.400748:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889ab2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc591 expref: 45 pid: 12533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.400774:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889ab2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc591 expref: 45 pid: 12533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.400837:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889ab2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc591 expref: 45 pid: 12533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.400860:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:2.0:1789683491.400866:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889aea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.400876:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889aea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.400885:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889aea lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.400923:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683491.401071:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889aea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401081:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889aea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683491.401142:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789683491.401147:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789683491.401193:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889aea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401207:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889aea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401217:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889adc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401223:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889adc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401230:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889adc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401252:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454ca00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683491.401257:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889adc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401265:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889adc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401276:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:3.0:1789683491.401279:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683491.401284:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889adc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401290:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889adc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401312:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401319:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889ae3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401326:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889ae3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401331:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683491.401333:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889ae3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401339:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889ae3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401365:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0fb8504e00) 00010000:00010000:3.0:1789683491.401367:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683491.401371:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889ae3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401377:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889ae3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401413:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889ad5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc59f expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401430:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889aea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc59f expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.401438:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:3.0:1789683491.401440:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683491.401443:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454ce00, rc 0) 00000100:00100000:3.0:1789683491.401497:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+44:11212:x1876618835435520:12345-192.168.201.50@tcp:101:stat.0 Request processed in 14115us (14389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683491.401506:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:2.0:1789683491.401632:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+43:2403:x1876618835435904:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 907us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683491.401648:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:0.0:1789683491.423090:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f85250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850206464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683491.423219:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683491.423342:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850206464 00000100:00100000:2.0:1789683491.423352:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850206464 00000100:00100000:2.0:1789683491.423413:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789683491.423423:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850206464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789683491.423462:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789683491.423522:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850206464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683491.423529:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789683491.426647:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f85250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850206464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683491.502315:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683491.502579:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835436160 00000100:00100000:2.0:1789683491.502590:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835436160 00000100:00100000:2.0:1789683491.502651:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:2.0:1789683491.502661:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+43:11218:x1876618835436160:12345-192.168.201.50@tcp:36:truncate.0 00010000:00010000:2.0:1789683491.502719:0:12533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683491.502746:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889aea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc59f expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.502766:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:2.0:1789683491.502772:0:12533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683491.502993:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889af1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.503007:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889af1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.503017:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889af1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789683491.503090:0:12533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1789683491.503113:0:12533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ed0fcb5 reply state 0000000069b47498 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889af1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.503126:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889af1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.503133:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:2.0:1789683491.503136:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789683491.503138:0:12533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683491.503251:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+45:11218:x1876618835436160:12345-192.168.201.50@tcp:36:truncate.0 Request processed in 589us (955us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789683491.503523:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 64 00000020:00080000:2.0:1789683491.503529:0:12533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789683491.681760:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683491.682088:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835436288 00000100:00100000:2.0:1789683491.682099:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835436288 00000100:00100000:2.0:1789683491.682163:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:2.0:1789683491.682175:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+45:11232:x1876618835436288:12345-192.168.201.50@tcp:101:stat.0 00010000:00010000:2.0:1789683491.682201:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683491.682223:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889af8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc5a6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682313:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889aff lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682329:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889aff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682341:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889aff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682369:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682376:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682382:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682461:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682471:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682477:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683491.682524:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1789683491.682530:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683491.682556:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682569:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682579:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889aff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682586:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889aff lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682603:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889aff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682610:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683491.682614:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889aff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682622:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889aff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682635:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:2.0:1789683491.682638:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683491.682643:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889aff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682649:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889aff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682665:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682671:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b06 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682676:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682681:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683491.682683:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682698:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682706:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0fb8504e00) 00010000:00010000:2.0:1789683491.682708:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683491.682711:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b06 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682717:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682746:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889af8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5a6 expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682760:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5a6 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.682767:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:2.0:1789683491.682769:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683491.682772:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30800, rc 0) 00000100:00100000:2.0:1789683491.682895:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+46:11232:x1876618835436288:12345-192.168.201.50@tcp:101:stat.0 Request processed in 720us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683491.682902:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:1.0:1789683491.801203:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683491.801918:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835436544 00000100:00100000:3.0:1789683491.801929:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835436544 00000100:00100000:3.0:1789683491.802009:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 66 00000100:00100000:3.0:1789683491.802022:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+46:11242:x1876618835436544:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789683491.802047:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683491.802069:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889b14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc5ad expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683491.802180:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789683491.802282:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889b14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5ad expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.802336:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e826a2500) 00010000:00010000:3.0:1789683491.802339:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683491.802346:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889b14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5ad expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683491.802363:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176200, rc 0) 00000100:00100000:3.0:1789683491.802435:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+47:11242:x1876618835436544:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 416us (1243us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1789683491.802445:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 66 00000100:00100000:0.0:1789683491.809640:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683491.809747:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835436800 00000100:00100000:1.0:1789683491.809767:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835436800 00000100:00100000:1.0:1789683491.809860:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:1.0:1789683491.809874:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+47:11242:x1876618835436800:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:1.0:1789683491.810114:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+48:11242:x1876618835436800:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 240us (482us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1789683491.810122:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 14 00010000:00010000:1.0:1789683491.871236:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683491.874605:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683491.874715:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835437056 00000100:00100000:2.0:1789683491.874726:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835437056 00000100:00100000:2.0:1789683491.874835:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:2.0:1789683491.874846:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+48:11248:x1876618835437056:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683491.874885:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683491.874905:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b22 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc5b4 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.875032:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b29 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.875048:0:12533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5a6 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.875057:0:12533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b29 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.875089:0:12533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5a6 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.875103:0:12533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5a6 expref: 49 pid: 6522 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683491.875115:0:12533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12533:1876618850206592:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683491.875212:0:12533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e835a5540 going to sleep for 11 seconds 00000100:00100000:3.0:1789683491.879411:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683491.879590:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835437184 00000100:00100000:0.0:1789683491.879601:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835437184 00010000:00010000:0.0:1789683491.879645:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b0d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5a6 expref: 50 pid: 6522 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683491.879701:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:0.0:1789683491.879711:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb29f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+50:2403:x1876618835437184:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683491.879727:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683491.879743:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b0d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5a6 expref: 50 pid: 6522 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.879763:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5a6 expref: 50 pid: 6522 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.879838:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:0.0:1789683491.879844:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b29 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.879854:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.879861:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b29 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683491.879880:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683491.879939:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb29f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+50:2403:x1876618835437184:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 228us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683491.879947:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 57 00010000:00010000:2.0:1789683491.880994:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5a6 expref: 49 pid: 6522 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683491.881017:0:12533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12533:1876618850206592:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683491.881040:0:12533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.881064:0:12533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.881070:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683491.881091:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789683491.881221:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b22 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5b4 expref: 50 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.881237:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b29 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5b4 expref: 49 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.881246:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:2.0:1789683491.881249:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789683491.881253:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31400, rc 0) 00000100:00100000:2.0:1789683491.881318:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+49:11248:x1876618835437056:12345-192.168.201.50@tcp:101:bash.0 Request processed in 6474us (6721us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789683491.881326:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:1.0:1789683491.886380:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683491.887007:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835437440 00000100:00100000:2.0:1789683491.887018:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835437440 00000100:00100000:2.0:1789683491.887124:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 68 00000100:00100000:2.0:1789683491.887136:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+49:11248:x1876618835437440:12345-192.168.201.50@tcp:36:bash.0 00010000:00010000:2.0:1789683491.887366:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889b37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.887384:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889b37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.887411:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889b37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789683491.887470:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1789683491.887492:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd6e098a reply state 000000007aa8852f transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889b37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.887505:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889b37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.887513:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:2.0:1789683491.887515:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789683491.887519:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683491.887622:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+52:11248:x1876618835437440:12345-192.168.201.50@tcp:36:bash.0 Request processed in 487us (1250us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1789683491.887629:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 68 00000020:00080000:2.0:1789683491.887634:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789683491.893482:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683491.894064:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835437568 00000100:00100000:2.0:1789683491.894075:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835437568 00000100:00100000:2.0:1789683491.894167:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:2.0:1789683491.894178:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+52:11248:x1876618835437568:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683491.894205:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683491.894224:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b889b3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc5bb expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.894319:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889b45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.894334:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b29 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5b4 expref: 53 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.894354:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889b45 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.894391:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b29 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5b4 expref: 53 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.894404:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b29 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5b4 expref: 53 pid: 12533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683491.894418:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1876618850206720:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683491.894505:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc0775180 going to sleep for 11 seconds 00000100:00100000:2.0:1789683491.897477:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1876618850206720:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683491.897515:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889b45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683491.899450:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683491.899532:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835437696 00000100:00100000:2.0:1789683491.899541:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835437696 00010000:00010000:2.0:1789683491.899593:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b29 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5b4 expref: 54 pid: 12533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683491.899638:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:2.0:1789683491.899648:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+54:2402:x1876618835437696:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683491.899663:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683491.899681:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b29 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5b4 expref: 54 pid: 12533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.899715:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b29 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5b4 expref: 54 pid: 12533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.899749:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b29 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5b4 expref: 54 pid: 12533 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.899771:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:2.0:1789683491.899776:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889b45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.899847:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889b45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.899858:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889b45 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683491.899885:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683491.899937:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+53:2402:x1876618835437696:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 290us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683491.899945:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 58 00010000:00010000:1.0:1789683491.900221:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889b45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683491.900230:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889b45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683491.900283:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789683491.900298:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789683491.900319:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889b45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683491.900348:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b889b3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5bb expref: 53 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683491.900363:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889b45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5bb expref: 52 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683491.900370:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:1.0:1789683491.900373:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683491.900383:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30400, rc 0) 00000100:00100000:1.0:1789683491.900411:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+52:11248:x1876618835437568:12345-192.168.201.50@tcp:101:bash.0 Request processed in 6235us (6942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683491.900417:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:1.0:1789683491.904665:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683491.904928:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835437952 00000100:00100000:3.0:1789683491.904939:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835437952 00000100:00100000:3.0:1789683491.904997:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:3.0:1789683491.905009:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f867cd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+52:11248:x1876618835437952:12345-192.168.201.50@tcp:35:bash.0 00000100:00100000:3.0:1789683491.905249:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f867cd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+53:11248:x1876618835437952:12345-192.168.201.50@tcp:35:bash.0 Request processed in 242us (593us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789683491.905257:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:3.0:1789683491.936144:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683491.936168:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f852ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850206848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683491.936235:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683491.936434:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850206848 00000100:00100000:0.0:1789683491.936442:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850206848 00000100:00100000:0.0:1789683491.936508:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789683491.936517:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850206848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789683491.936549:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683491.936611:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850206848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683491.936618:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789683491.936678:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f852ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850206848:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789683491.937562:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683492.013654:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683492.013765:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835438208 00000100:00100000:3.0:1789683492.013823:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835438208 00000100:00100000:3.0:1789683492.013891:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 70 00000100:00100000:3.0:1789683492.013902:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+53:11258:x1876618835438208:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789683492.013925:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683492.013944:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889b4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc5c2 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683492.014037:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789683492.014129:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889b4c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5c2 expref: 55 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.014144:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e826a2500) 00010000:00010000:3.0:1789683492.014147:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683492.014152:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889b4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5c2 expref: 55 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.014165:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176200, rc 0) 00000100:00100000:3.0:1789683492.014216:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+54:11258:x1876618835438208:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 316us (572us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1789683492.014223:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 70 00000100:00080000:1.0:1789683492.014344:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683492.020173:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683492.020376:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835438336 00000100:00100000:2.0:1789683492.020387:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835438336 00000100:00100000:2.0:1789683492.020652:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 71 00000100:00100000:2.0:1789683492.020676:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+54:11258:x1876618835438336:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:2.0:1789683492.020777:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b5a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.020819:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.020846:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.020859:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.020867:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.020873:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.020947:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.020956:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.020964:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683492.021016:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021029:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021036:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b5a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021043:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021059:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683492.021064:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021072:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b5a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021084:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:2.0:1789683492.021087:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683492.021092:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021099:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021113:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021120:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021127:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021133:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683492.021136:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021143:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021162:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0fb8504e00) 00010000:00010000:2.0:1789683492.021165:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683492.021168:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021175:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021186:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021193:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b68 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021200:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021206:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683492.021210:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021215:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021222:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:2.0:1789683492.021224:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683492.021227:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b68 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.021233:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683492.021708:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+54:11258:x1876618835438336:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 1043us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683492.021717:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 71 00000100:00100000:1.0:1789683492.025056:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683492.025145:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835438592 00000100:00100000:3.0:1789683492.025154:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835438592 00000100:00100000:3.0:1789683492.025232:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:3.0:1789683492.025242:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+54:11258:x1876618835438592:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789683492.025510:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+55:11258:x1876618835438592:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 268us (461us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789683492.025518:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:1.0:1789683492.057480:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683492.057980:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835438848 00000100:00100000:2.0:1789683492.057991:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835438848 00000100:00100000:2.0:1789683492.058154:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:2.0:1789683492.058165:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+55:11261:x1876618835438848:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683492.058192:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683492.058212:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc5c9 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058297:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b76 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058314:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058326:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058339:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058346:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058352:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058589:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889b84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058600:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889b84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058607:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889b84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683492.058617:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789683492.058697:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058705:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b76 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058711:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b76 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058717:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683492.058721:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b76 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058727:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b76 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058739:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:2.0:1789683492.058742:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683492.058759:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058775:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889b76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058817:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058823:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b7d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058829:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058834:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683492.058837:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058842:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058849:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0fb8504e00) 00010000:00010000:2.0:1789683492.058852:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683492.058855:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b7d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058860:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889b7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058892:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889b6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5c9 expref: 58 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058904:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889b84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5c9 expref: 57 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.058917:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:2.0:1789683492.058920:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683492.058923:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31200, rc 0) 00000100:00100000:2.0:1789683492.058992:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+57:11261:x1876618835438848:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 829us (1547us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789683492.058999:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:0.0:1789683492.065057:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683492.065148:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683492.065223:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835439104 00000100:00100000:2.0:1789683492.065234:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835439104 00000100:00100000:2.0:1789683492.065311:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:2.0:1789683492.065323:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+57:2405:x1876618835439104:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683492.065341:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683492.065368:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889b84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5c9 expref: 57 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.065387:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:2.0:1789683492.065393:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683492.065461:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+56:2405:x1876618835439104:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 140us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683492.065468:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:3.0:1789683492.066686:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835438976 00000100:00100000:3.0:1789683492.066696:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835438976 00000100:00100000:3.0:1789683492.066805:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 73 00000100:00100000:3.0:1789683492.066815:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+56:11261:x1876618835438976:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:3.0:1789683492.066878:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889b92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.066895:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889b92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.066908:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889b92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.066945:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889b92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.066953:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889b92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.066959:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889b92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.066965:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683492.066969:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889b92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.066976:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889b92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.066985:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:3.0:1789683492.066988:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683492.066992:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889b92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.067010:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889b92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683492.067074:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+56:11261:x1876618835438976:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 260us (2027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683492.067081:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 73 00000100:00100000:0.0:1789683492.070341:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683492.070432:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835439360 00000100:00100000:2.0:1789683492.070443:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835439360 00000100:00100000:2.0:1789683492.070525:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:2.0:1789683492.070537:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+56:11261:x1876618835439360:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:2.0:1789683492.070805:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+57:11261:x1876618835439360:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 250us (455us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789683492.070828:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:1.0:1789683492.201545:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683492.201636:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835439616 00000100:00100000:2.0:1789683492.201648:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835439616 00000100:00100000:2.0:1789683492.201725:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 74 00000100:00100000:2.0:1789683492.201738:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+57:11279:x1876618835439616:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:2.0:1789683492.201772:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683492.201835:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889b99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc5d0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.201951:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889ba0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.201968:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889ba0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.201980:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889ba0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683492.201992:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789683492.202097:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889b99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5d0 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.202115:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889ba0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5d0 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.202125:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:2.0:1789683492.202128:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789683492.202133:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30800, rc 0) 00000100:00100000:2.0:1789683492.202203:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+59:11279:x1876618835439616:12345-192.168.201.50@tcp:101:cat.0 Request processed in 468us (669us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1789683492.202210:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 74 00000100:00100000:0.0:1789683492.233068:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683492.233179:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835439744 00000100:00100000:2.0:1789683492.233189:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835439744 00000100:00100000:2.0:1789683492.233260:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 75 00000100:00100000:2.0:1789683492.233271:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+59:11280:x1876618835439744:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683492.233308:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683492.233335:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889bae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc5d7 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.233407:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889bb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.233424:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.233436:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683492.233494:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789683492.233498:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683492.233517:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.233545:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889bae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5d7 expref: 61 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.233563:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5d7 expref: 60 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.233598:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:2.0:1789683492.233601:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683492.233604:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31400, rc 0) 00000100:00100000:2.0:1789683492.233666:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+60:11280:x1876618835439744:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 397us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683492.233673:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 75 00000100:00100000:0.0:1789683492.239228:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683492.239332:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835440128 00000100:00100000:3.0:1789683492.239342:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835440128 00000100:00100000:3.0:1789683492.239399:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:3.0:1789683492.239410:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+60:11280:x1876618835440128:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789683492.240025:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+61:11280:x1876618835440128:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 614us (805us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789683492.240034:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:1.0:1789683492.243110:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683492.243217:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835440256 00000100:00100000:2.0:1789683492.243228:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835440256 00000100:00100000:2.0:1789683492.243310:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:2.0:1789683492.243321:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+61:11280:x1876618835440256:12345-192.168.201.50@tcp:103:lfs.0 00010000:00010000:2.0:1789683492.243339:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789683492.243365:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889b45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5bb expref: 61 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.243388:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889ba0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5d0 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.243401:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889a42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc575 expref: 59 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.243411:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:2.0:1789683492.243416:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683492.243490:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+58:11280:x1876618835440256:12345-192.168.201.50@tcp:103:lfs.0 Request processed in 171us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683492.243497:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:0.0:1789683492.245993:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683492.246123:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835440384 00000100:00100000:3.0:1789683492.246133:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835440384 00000100:00100000:3.0:1789683492.246188:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 76 00000100:00100000:3.0:1789683492.246199:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+58:11280:x1876618835440384:12345-192.168.201.50@tcp:58:lfs.0 00010000:00010000:3.0:1789683492.246317:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889bbc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.246333:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889bbc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.246345:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889bbc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789683492.246716:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683492.246899:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1789683492.246990:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1789683492.247328:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+58:11280:x1876618835440384:12345-192.168.201.50@tcp:58:lfs.0 Request processed in 1127us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683492.247336:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 76 00000100:00100000:3.0:1789683492.269011:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683492.269141:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835440512 00000100:00100000:2.0:1789683492.269152:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835440512 00000100:00100000:2.0:1789683492.269224:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 77 00000100:00100000:2.0:1789683492.269236:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+58:11282:x1876618835440512:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683492.269258:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683492.269279:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889bc3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc5de expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.269362:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889bca lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.269377:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889bca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.269389:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889bca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.269401:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889bd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.269409:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.269416:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.269510:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889bd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.269519:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.269547:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683492.269848:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789683492.269853:0:12533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683492.269879:0:12533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.269894:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.269903:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889bca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.269911:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889bca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.269918:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889bca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.269924:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683492.269930:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889bca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.269938:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889bca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.269952:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:2.0:1789683492.269955:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683492.269960:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889bca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.269977:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889bca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.269998:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.270004:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889bd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.270010:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.270015:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683492.270018:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.270024:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889bd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.270031:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0fb8504e00) 00010000:00010000:2.0:1789683492.270033:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683492.270037:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889bd1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.270042:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889bd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.270071:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889bc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5de expref: 60 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.270100:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5de expref: 59 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.270108:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:2.0:1789683492.270110:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683492.270113:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30e00, rc 0) 00000100:00100000:2.0:1789683492.270178:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+59:11282:x1876618835440512:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 945us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683492.270185:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 77 00000100:00100000:0.0:1789683492.447899:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683492.447923:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850206976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683492.447990:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683492.448047:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850206976 00000100:00100000:0.0:1789683492.448054:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850206976 00000100:00100000:0.0:1789683492.448105:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789683492.448125:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850206976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683492.448148:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683492.448191:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850206976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683492.448198:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1789683492.448218:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683492.448255:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850206976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683492.449868:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683492.449891:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850207104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683492.449951:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683492.450001:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850207104 00000100:00100000:3.0:1789683492.450007:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850207104 00000100:00100000:3.0:1789683492.450046:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789683492.450053:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850207104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789683492.450082:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446268928 avail 1300029440 00000100:00100000:3.0:1789683492.450122:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850207104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683492.450129:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789683492.450174:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850207104:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789683492.895057:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683492.895068:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683492.895104:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789683492.895115:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789683492.895255:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a10700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1876618850207232:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789683492.895368:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865ea3c0 going to sleep for 11 seconds 00000040:00080000:0.0:1789683492.896098:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789683492.896503:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683492.908126:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683492.910197:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a10700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1876618850207232:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789683492.915103:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835440640 00000100:00100000:3.0:1789683492.915119:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835440640 00000100:00100000:3.0:1789683492.915194:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 78 00000100:00100000:3.0:1789683492.915204:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+59:11293:x1876618835440640:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789683492.915238:0:6523:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789683492.915382:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+59:11293:x1876618835440640:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 180us (7265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683492.915390:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 78 00000001:00080000:0.0:1789683492.921409:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:0.0:1789683492.921471:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1789683492.921492:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f0fc14f1cc0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789683492.921497:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0f8c273400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f0fc14f1540 00000020:00080000:0.0:1789683492.921500:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0f8c273700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f0e81d47600 00000020:00080000:0.0:1789683492.921548:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1789683492.921726:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:3.0:1789683492.921914:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b88997e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.921934:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b88997e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.921942:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b88997e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.921948:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683492.921953:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b88997e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.921960:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b88997e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.921978:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f0e826a2a00) 00010000:00010000:3.0:1789683492.921981:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683492.921986:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b88997e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.921992:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b88997e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922013:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889985 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922020:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889985 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922026:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889985 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922031:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683492.922041:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889985 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922047:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889985 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922056:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:3.0:1789683492.922058:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683492.922061:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889985 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922067:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889985 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922084:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b8899c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922090:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b8899c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922096:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b8899c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922101:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837db600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683492.922103:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b8899c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922109:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b8899c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922116:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0fb8504e00) 00010000:00010000:3.0:1789683492.922118:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683492.922128:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b8899c4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922134:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b8899c4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922151:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889ace lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922157:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889ace lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922161:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889ace lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922166:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683492.922168:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889ace lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922173:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889ace lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922181:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:3.0:1789683492.922183:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683492.922186:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889ace lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922191:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889ace lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922201:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889af1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922206:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889af1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922217:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889af1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922223:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683492.922226:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889af1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922231:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889af1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922238:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:3.0:1789683492.922240:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683492.922243:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889af1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922248:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889af1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922260:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889b37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922266:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889b37 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922290:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889b37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922295:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683492.922298:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889b37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922314:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889b37 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922322:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:3.0:1789683492.922324:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683492.922327:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889b37 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.922332:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889b37 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683492.926204:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850207360:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789683492.926297:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683492.926377:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850207360 00000100:00100000:3.0:1789683492.926385:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850207360 00000100:00100000:3.0:1789683492.926446:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789683492.926473:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1876618850207360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789683492.926502:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1789683492.926536:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aac6722, atime: 0x6aac6722, ctime: 0x6aac6722, blocks: 0x8 00010000:00010000:3.0:1789683492.926546:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b889bdf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.926575:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789683492.926580:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683492.926586:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b889bdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.926607:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b889bdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.926623:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b889bdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.926631:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b889bdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.926650:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789683492.926835:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1876618850207360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 363us (537us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789683492.926843:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789683492.926869:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789683492.926879:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683492.926885:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b889bdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.926892:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683492.926896:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b889bdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.926905:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b889bdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.926920:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b889bdf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.926937:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b889bdf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.926955:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683492.926957:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683492.926958:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789683492.926988:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0fb7a10700/2, rc 0, transno 4294967302 00000100:00100000:3.0:1789683492.926994:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850207360:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789683492.928603:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683492.933025:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835440768 00000100:00100000:0.0:1789683492.933042:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835440768 00000100:00100000:0.0:1789683492.933162:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 79 00000100:00100000:0.0:1789683492.933174:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+12:11293:x1876618835440768:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789683492.933262:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c800/0xcf8485587b889be6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.933290:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c800/0xcf8485587b889be6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.933301:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c800/0xcf8485587b889be6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.933363:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889bed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.933371:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889bed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.933378:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889bed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.933405:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889bf4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.933413:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.933420:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683492.933470:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789683492.933475:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683492.933488:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.933500:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c800/0xcf8485587b889be6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.933507:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c800/0xcf8485587b889be6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.933514:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c800/0xcf8485587b889be6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.933529:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454c800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683492.933534:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c800/0xcf8485587b889be6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.933542:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c800/0xcf8485587b889be6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.935721:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0f854c2c00) 00010000:00010000:0.0:1789683492.935732:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683492.935743:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c800/0xcf8485587b889be6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.935751:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c800/0xcf8485587b889be6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.935773:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889bed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.935780:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889bed lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.935810:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889bed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.935815:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454da00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683492.935819:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889bed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.935826:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889bed lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.935855:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9f0e835a6e00) 00010000:00010000:0.0:1789683492.935858:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683492.935861:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889bed lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.935867:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889bed lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.935887:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.935893:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889bf4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.935898:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.935902:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454c000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683492.935905:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.935910:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889bf4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.935916:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:0.0:1789683492.935918:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683492.935921:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889bf4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683492.935926:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889bf4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683492.936042:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+12:11293:x1876618835440768:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 Request processed in 2865us (7441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683492.936053:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 79 00000100:00100000:3.0:1789683492.940298:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683492.944484:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835441024 00000100:00100000:1.0:1789683492.944504:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835441024 00000100:00100000:1.0:1789683492.946726:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 80 00000100:00100000:1.0:1789683492.946759:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+12:11293:x1876618835441024:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789683492.946800:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683492.946824:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b889bfb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc5e5 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683492.946964:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889c02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683492.946982:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889c02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683492.946994:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889c02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683492.947007:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789683492.947092:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889c02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683492.947100:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889c02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683492.947107:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889c02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683492.947113:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837db600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683492.947117:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889c02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683492.947124:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889c02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683492.947137:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:1.0:1789683492.947139:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683492.947145:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889c02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683492.947161:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889c02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683492.947208:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b889bfb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5e5 expref: 14 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683492.947219:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0f854c2c00) 00010000:00010000:1.0:1789683492.947221:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789683492.947225:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b889bfb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5e5 expref: 14 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683492.947235:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81391a00, rc 0) 00000100:00100000:1.0:1789683492.947318:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+13:11293:x1876618835441024:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 570us (7030us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1789683492.947325:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 80 00000100:00100000:2.0:1789683492.956221:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683492.956988:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835441152 00000100:00100000:1.0:1789683492.956999:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835441152 00000100:00100000:1.0:1789683492.957067:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 81 00000100:00100000:1.0:1789683492.957082:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+13:11293:x1876618835441152:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789683492.957122:0:6522:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789683492.957241:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+13:11293:x1876618835441152:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 162us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683492.957249:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 81 00000100:00100000:1.0:1789683492.967334:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683492.967807:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835441408 00000100:00100000:3.0:1789683492.967820:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835441408 00000100:00100000:3.0:1789683492.967884:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 82 00000100:00100000:3.0:1789683492.967897:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+13:11293:x1876618835441408:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683492.967921:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683492.967925:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789683492.967956:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889bb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5d7 expref: 13 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.967978:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:3.0:1789683492.967984:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683492.968001:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889c10 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc5ec expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789683492.968489:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1789683492.968666:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889c17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.968681:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889c17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.968692:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889c17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.968749:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889c10 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5ec expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.968766:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889c17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5ec expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.968775:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0e826a2700) 00010000:00010000:3.0:1789683492.968778:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683492.968806:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6177400, rc 0) 00000100:00100000:3.0:1789683492.968871:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+14:11293:x1876618835441408:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 976us (1547us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789683492.968879:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 82 00000100:00100000:3.0:1789683492.976528:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683492.976624:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835441664 00000100:00100000:2.0:1789683492.976636:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835441664 00000100:00100000:2.0:1789683492.976703:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 83 00000100:00100000:2.0:1789683492.976715:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+14:11293:x1876618835441664:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789683492.976816:0:12533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683492.976843:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889c17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5ec expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.976863:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0e826a2700) 00010000:00010000:2.0:1789683492.976873:0:12533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683492.976895:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889c25 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.976910:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889c25 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.976941:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889c25 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.976956:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889c2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xd0d24b87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.976963:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889c2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd0d24b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.976969:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889c2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd0d24b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.977017:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889c25 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.977025:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889c25 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.977031:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889c25 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.977037:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683492.977041:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889c25 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.977048:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889c25 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.977057:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:2.0:1789683492.977060:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683492.977064:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889c25 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.977076:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889c25 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.977088:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889c2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd0d24b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.977094:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889c2c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd0d24b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.977100:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889c2c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd0d24b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.977105:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683492.977108:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889c2c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd0d24b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.977114:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889c2c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd0d24b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.977122:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xd0d24b87 (ffff9f0f83e0b500) 00010000:00010000:2.0:1789683492.977125:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683492.977128:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889c2c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd0d24b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.977134:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889c2c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd0d24b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683492.977221:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+13:11293:x1876618835441664:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 508us (704us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789683492.977229:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 83 00000100:00100000:0.0:1789683492.982401:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683492.982643:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835441792 00000100:00100000:2.0:1789683492.982653:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835441792 00000100:00100000:2.0:1789683492.982711:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 84 00000100:00100000:2.0:1789683492.982720:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+13:11293:x1876618835441792:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683492.982747:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683492.982766:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889c33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc5f3 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.982833:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b889c3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.982848:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b889c3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.982860:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b889c3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.983086:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889c33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5f3 expref: 15 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.984071:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b889c3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5f3 expref: 14 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683492.984081:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0f83e0bf00) 00010000:00010000:2.0:1789683492.984084:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789683492.984292:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31a00, rc 0) 00000100:00100000:2.0:1789683492.984370:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+14:11293:x1876618835441792:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 1650us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683492.984379:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 84 00000100:00100000:3.0:1789683492.996743:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683492.996818:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835442048 00000100:00100000:3.0:1789683492.996832:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835442048 00000100:00100000:3.0:1789683492.996896:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 85 00000100:00100000:3.0:1789683492.996907:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+14:11293:x1876618835442048:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789683492.996995:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.997028:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683492.997041:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789683492.997225:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1789683492.997235:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 407046450125ns, next at 408046447796ns, rc = 0 00000004:00010000:3.0:1789683493.002205:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6d00987 reply state 0000000026091693 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.002234:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.002244:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0f83e0bf00) 00010000:00010000:3.0:1789683493.002247:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789683493.002253:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789683493.002420:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+16:11293:x1876618835442048:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 5510us (5684us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789683493.002430:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 85 00000100:00100000:3.0:1789683493.006052:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683493.006108:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835442176 00000100:00100000:3.0:1789683493.006119:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835442176 00000100:00100000:3.0:1789683493.006178:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 86 00000100:00100000:3.0:1789683493.006190:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+16:11293:x1876618835442176:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683493.006216:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683493.006236:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889c48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc5fa expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.006326:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889c48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5fa expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.006342:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889c48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5fa expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.006368:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0f83e0bf00) 00010000:00010000:3.0:1789683493.006372:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789683493.006377:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176e00, rc 0) 00000100:00100000:3.0:1789683493.006443:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+17:11293:x1876618835442176:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 255us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683493.006449:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 86 00000100:00100000:3.0:1789683493.014955:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683493.015297:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835442304 00000100:00100000:1.0:1789683493.015308:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835442304 00000100:00100000:1.0:1789683493.015378:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:1.0:1789683493.015387:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1876618835442304:12345-192.168.201.50@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789683493.015424:0:8439:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp t0 exp 0000000000000000 cur 407 last 0 00000020:00000080:1.0:1789683493.015456:0:8439:0:(genops.c:1384:class_connect()) connect: client ec036ece-1720-411a-849c-c978dbb41f8a, cookie 0xcf8485587b889c4f 00002000:00100000:1.0:1789683493.015470:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ec036ece-1720-411a-849c-c978dbb41f8a/ffff9f0fb79ab000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789683493.015488:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:1.0:1789683493.015568:0:8439:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789683493.015600:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9f0fb79ac000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683493.015673:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:2401:x1876618835442304:12345-192.168.201.50@tcp:8:lhsmtool_posix.0 Request processed in 284us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683493.015681:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:3.0:1789683493.019193:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683493.019687:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835442432 00000100:00100000:1.0:1789683493.019698:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835442432 00000100:00100000:1.0:1789683493.020874:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:1.0:1789683493.020953:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec036ece-1720-411a-849c-c978dbb41f8a+6:0:x1876618835442432:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789683493.023229:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789683493.030591:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1789683493.030608:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec036ece-1720-411a-849c-c978dbb41f8a 00000100:00100000:3.0:1789683493.031148:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:0:x1876618835442432:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 10254us (11958us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789683493.031162:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:3.0:1789683493.033711:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683493.033808:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835442688 00000100:00100000:2.0:1789683493.033819:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835442688 00000100:00100000:2.0:1789683493.033873:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:2.0:1789683493.033883:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+17:11293:x1876618835442688:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789683493.034134:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+18:11293:x1876618835442688:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 251us (431us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1789683493.034142:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:0.0:1789683493.036456:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683493.036528:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835442944 00000100:00100000:2.0:1789683493.036543:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835442944 00000100:00100000:2.0:1789683493.036601:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 87 00000100:00100000:2.0:1789683493.036612:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+18:11293:x1876618835442944:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789683493.036725:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+18:11293:x1876618835442944:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 115us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683493.036733:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 87 00000100:00100000:3.0:1789683493.042238:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683493.042465:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835443072 00000100:00100000:0.0:1789683493.042479:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835443072 00000100:00100000:0.0:1789683493.042548:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 88 00000100:00100000:0.0:1789683493.042570:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+18:11293:x1876618835443072:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683493.042598:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683493.042624:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b889c56 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc601 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.042693:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b889c5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.042709:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b889c5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.042723:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b889c5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683493.043333:0:12533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683493.043359:0:12533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b889c5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.043414:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b889c56 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc601 expref: 20 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.043435:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b889c5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc601 expref: 19 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.043444:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0f83e0bf00) 00010000:00010000:0.0:1789683493.043447:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789683493.043451:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d400, rc 0) 00000100:00100000:0.0:1789683493.043519:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+19:11293:x1876618835443072:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 962us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683493.043527:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 88 00000100:00100000:0.0:1789683493.049252:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683493.049505:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835443200 00000100:00100000:1.0:1789683493.049516:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835443200 00000100:00100000:1.0:1789683493.049580:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00100000:1.0:1789683493.049590:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835443200:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789683493.049611:0:14000:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683493.049632:0:14000:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c855b7b/0xcf8485587b889c64 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc608 expref: -99 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789683493.049660:0:14000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac6725, blocks: 0x0 00010000:00010000:1.0:1789683493.049678:0:14000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1789683493.049689:0:14000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683493.049699:0:14000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c855b7b/0xcf8485587b889c64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc608 expref: 6 pid: 14000 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.049719:0:14000:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003c855b7b/0xcf8485587b889c64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc608 expref: 6 pid: 14000 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.049733:0:14000:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da200, rc 0) 00000100:00100000:1.0:1789683493.049814:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+6:2403:x1876618835443200:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 226us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683493.049822:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00100000:3.0:1789683493.053014:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683493.053113:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835443456 00000100:00100000:0.0:1789683493.053123:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835443456 00000100:00100000:0.0:1789683493.053188:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 89 00000100:00100000:0.0:1789683493.053198:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+19:11293:x1876618835443456:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789683493.053329:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+19:11293:x1876618835443456:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 131us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683493.053337:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 89 00000100:00100000:3.0:1789683493.056489:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683493.056588:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835443584 00000100:00100000:1.0:1789683493.056598:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835443584 00000100:00100000:1.0:1789683493.058207:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 36 00000100:00100000:1.0:1789683493.058225:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+6:11293:x1876618835443584:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789683493.058244:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683493.058263:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b889c6b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc60f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.058307:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c855b7b/0xcf8485587b889c64 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc608 expref: 7 pid: 14000 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.058318:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683493.058323:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683493.058329:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b889c6b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc60f expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.058375:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c855b7b/0xcf8485587b889c64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc608 expref: 7 pid: 14000 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.058389:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c855b7b/0xcf8485587b889c64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc608 expref: 7 pid: 14000 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683493.058404:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8437:1876618850207488:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789683493.058542:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865ea300 going to sleep for 11 seconds 00000100:00100000:2.0:1789683493.069229:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8437:1876618850207488:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683493.069281:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b889c6b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc60f expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683493.069304:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837daa00, rc 0) 00000100:00100000:2.0:1789683493.069366:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+7:11293:x1876618835443584:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 11145us (12887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683493.069375:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 36 00000100:00100000:2.0:1789683493.071402:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683493.071473:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835443712 00000100:00100000:0.0:1789683493.071483:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835443712 00010000:00010000:0.0:1789683493.071529:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c855b7b/0xcf8485587b889c64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc608 expref: 7 pid: 14000 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683493.071982:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:0.0:1789683493.071999:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+7:2402:x1876618835443712:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683493.072192:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683493.072450:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003c855b7b/0xcf8485587b889c64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc608 expref: 7 pid: 14000 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.072469:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003c855b7b/0xcf8485587b889c64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc608 expref: 7 pid: 14000 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.072493:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c855b7b/0xcf8485587b889c64 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc608 expref: 7 pid: 14000 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.072509:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683493.072514:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683493.072522:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b889c6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc60f expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.072532:0:10343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b889c6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc60f expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.072591:0:10343:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b889c6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc60f expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683493.072607:0:10343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83771880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10343:1876618850207616:192.168.201.50@tcp:105: 00000100:00100000:0.0:1789683493.072709:0:10343:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8bb9c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789683493.082524:0:10343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83771880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10343:1876618850207616:192.168.201.50@tcp:105: 00010000:00010000:3.0:1789683493.082558:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683493.082632:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835443712:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 10634us (11239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683493.082662:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:1.0:1789683493.091538:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683493.092342:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835443840 00000100:00100000:3.0:1789683493.092359:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835443840 00002000:00100000:3.0:1789683493.092417:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9f0fb7a11500 x1876618835443840/t0(0) o4->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:549/0 lens 504/0 e 0 to 0 dl 1789683504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789683493.092429:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0fb7a11500 with x1876618835443840 ext(0->8) 00002000:00010000:3.0:1789683493.092435:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0fb7a11500 00000100:00100000:3.0:1789683493.092471:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:3.0:1789683493.092481:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835443840:12345-192.168.201.50@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789683493.099959:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec036ece-1720-411a-849c-c978dbb41f8a+8:2402:x1876618835443840:12345-192.168.201.50@tcp:4:lhsmtool_posix.0 Request processed in 7468us (8422us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789683493.099974:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 0 00002000:00100000:3.0:1789683493.099989:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9f0fb7a11500 x1876618835443840/t4294967303(0) o4->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:549/0 lens 504/448 e 0 to 0 dl 1789683504 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789683493.100000:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0fb7a11500 with x1876618835443840 ext(0->8) 00002000:00010000:3.0:1789683493.100470:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0fb7a11500 00000100:00100000:0.0:1789683493.107382:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683493.108102:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835443968 00000100:00100000:3.0:1789683493.108112:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835443968 00000100:00100000:3.0:1789683493.108177:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 90 00000100:00100000:3.0:1789683493.108188:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+19:11293:x1876618835443968:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789683493.111309:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1789683493.111326:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789683493.111356:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1789683493.111381:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1789683493.111396:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789683493.111534:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+15:11293:x1876618835443968:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 Request processed in 3343us (4157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683493.111545:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 90 00010000:00010000:3.0:1789683493.111685:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.111698:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.111713:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.111719:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683493.111723:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.111731:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.111746:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0f83e0bf00) 00010000:00010000:3.0:1789683493.111749:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789683493.111754:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c41 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.111761:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c41 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683493.112496:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850207744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789683493.112561:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683493.115137:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850207744 00000100:00100000:3.0:1789683493.115152:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850207744 00000100:00100000:1.0:1789683493.115381:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683493.115440:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835444096 00000100:00100000:3.0:1789683493.115444:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835444096 00000100:00100000:3.0:1789683493.115496:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 37 00000100:00100000:3.0:1789683493.115507:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+8:2402:x1876618835444096:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789683493.117412:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789683493.117424:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83773480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850207744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789683493.117571:0:8676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789683493.117575:0:8676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789683493 00002000:00010000:2.0:1789683493.117578:0:8676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789683493.117580:0:8676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789683493 -> 1789683493 00002000:00010000:2.0:1789683493.117582:0:8676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789683493.117669:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83773480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1876618850207744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 247us (5107us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789683493.117678:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000004:00080000:0.0:1789683493.117771:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0fb7a12300/2, rc 0, transno 4294967304 00000100:00100000:0.0:1789683493.117815:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850207744:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1789683493.119196:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1789683493.119351:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835444096:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 Request processed in 3842us (3971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683493.119361:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 37 00000100:00100000:1.0:1789683493.136160:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683493.136250:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835444352 00000100:00100000:3.0:1789683493.136261:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835444352 00000100:00100000:3.0:1789683493.136331:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 91 00000100:00100000:3.0:1789683493.136341:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+14:11293:x1876618835444352:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789683493.136408:0:12533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683493.136434:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b889c5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc601 expref: 14 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.136454:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0f83e0bf00) 00010000:00010000:3.0:1789683493.136459:0:12533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683493.136487:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c72 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.136505:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.136515:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683493.136645:0:12533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fc1d7bc reply state 000000002392ab3f transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.136658:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.136664:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0f83e0bf00) 00010000:00010000:3.0:1789683493.136667:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789683493.136670:0:12533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789683493.136760:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+15:11293:x1876618835444352:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 419us (610us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1789683493.136767:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 91 00000100:00100000:1.0:1789683493.141328:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683493.141520:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835444480 00000100:00100000:3.0:1789683493.141535:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835444480 00000100:00100000:3.0:1789683493.141610:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 39 00000100:00100000:3.0:1789683493.141637:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+6:2403:x1876618835444480:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789683493.141832:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789683493.141836:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789683493 -> 1789683492 00002000:00010000:3.0:1789683493.141839:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789683490 00002000:00010000:3.0:1789683493.141841:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789683493 -> 1789683492 00002000:00010000:3.0:1789683493.141843:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789683493.141905:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+7:2403:x1876618835444480:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 270us (586us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789683493.141914:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 39 00000100:00100000:0.0:1789683493.159064:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683493.159107:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835444736 00000100:00100000:0.0:1789683493.159116:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835444736 00000100:00100000:0.0:1789683493.159157:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 92 00000100:00100000:0.0:1789683493.159164:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+15:11293:x1876618835444736:12345-192.168.201.50@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789683493.159229:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889c79 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.159246:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b889c3a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5f3 expref: 15 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.159256:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889c79 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.159315:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b889c3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5f3 expref: 15 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.159326:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b889c3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5f3 expref: 15 pid: 8462 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683493.159336:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83772d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876618850207872:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789683493.159418:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa3600 going to sleep for 11 seconds 00000100:00100000:1.0:1789683493.171631:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683493.171982:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83772d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876618850207872:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683493.172014:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889c79 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683493.172202:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835444864 00000100:00100000:2.0:1789683493.172210:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835444864 00010000:00010000:2.0:1789683493.172251:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b889c3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5f3 expref: 16 pid: 8462 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683493.172297:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:2.0:1789683493.172307:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+16:2403:x1876618835444864:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683493.172323:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683493.172330:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b889c3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5f3 expref: 16 pid: 8462 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683493.172352:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b889c3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5f3 expref: 16 pid: 8462 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683493.172375:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b889c3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5f3 expref: 16 pid: 8462 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683493.172392:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0f83e0bf00) 00010000:00010000:2.0:1789683493.172399:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889c79 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683493.172408:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889c79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683493.172416:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889c79 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683493.172438:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683493.172490:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+15:2403:x1876618835444864:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 183us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683493.172498:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 60 00000040:00080000:1.0:1789683493.173846:0:14215:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683493.173853:0:14215:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683493.173892:0:14215:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789683493.173901:0:14215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789683493.175345:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889c79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.175358:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889c79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.175399:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889c79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.175407:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889c79 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.175414:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889c79 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.175419:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683493.175424:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889c79 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.175432:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889c79 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.175447:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0f83e0bf00) 00010000:00010000:0.0:1789683493.175450:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789683493.175454:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889c79 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.175470:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889c79 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683493.175553:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+14:11293:x1876618835444736:12345-192.168.201.50@tcp:55:lhsmtool_posix.0 Request processed in 16384us (16496us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789683493.175563:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 92 00000100:00100000:0.0:1789683493.179205:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683493.179924:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835444992 00000100:00100000:2.0:1789683493.179935:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835444992 00000100:00100000:3.0:1789683493.180015:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 40 00000100:00100000:3.0:1789683493.180029:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83772d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+7:2402:x1876618835444992:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789683493.180076:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e8b298e8/0xcf8485587b889c80 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.180098:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b889c6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc60f expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.180107:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683493.180112:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683493.180116:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8b298e8/0xcf8485587b889c80 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.180152:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b889c6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc60f expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.180165:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b889c6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc60f expref: 7 pid: 8437 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683493.180188:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84416300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1876618850208000:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789683493.180370:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683493.185650:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683493.185687:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835445120 00000100:00100000:3.0:1789683493.185696:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835445120 00010000:00010000:3.0:1789683493.185746:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b889c6b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc60f expref: 8 pid: 8437 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683493.185813:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:3.0:1789683493.185822:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84414380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+8:2403:x1876618835445120:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683493.185841:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683493.185864:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b889c6b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc60f expref: 8 pid: 8437 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.185879:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b889c6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc60f expref: 8 pid: 8437 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.185912:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683493.185917:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683493.185923:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8b298e8/0xcf8485587b889c80 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.185934:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8b298e8/0xcf8485587b889c80 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.185976:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683493.186040:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84414380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+8:2403:x1876618835445120:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 219us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683493.186049:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 61 00010000:00010000:3.0:1789683493.186106:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b889c6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc60f expref: 7 pid: 8437 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683493.186121:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84416300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1876618850208000:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789683493.186142:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e8b298e8/0xcf8485587b889c80 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.186152:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e8b298e8/0xcf8485587b889c80 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.186160:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8b298e8/0xcf8485587b889c80 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.186181:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e8b298e8/0xcf8485587b889c80 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.186190:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8b298e8/0xcf8485587b889c80 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.186197:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8b298e8/0xcf8485587b889c80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.186223:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683493.186227:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8b298e8/0xcf8485587b889c80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.186236:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8b298e8/0xcf8485587b889c80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.186247:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8b298e8/0xcf8485587b889c80 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.186254:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8b298e8/0xcf8485587b889c80 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683493.186306:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83772d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835444992:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 Request processed in 6282us (7110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683493.186314:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 40 00000100:00100000:2.0:1789683493.192260:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683493.192364:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835445376 00000100:00100000:1.0:1789683493.192380:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835445376 00000100:00100000:1.0:1789683493.192445:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 93 00000100:00100000:1.0:1789683493.192455:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+14:11293:x1876618835445376:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789683493.192553:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889c87 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.192575:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b889ac7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc598 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.192604:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889c87 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.192648:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b889ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc598 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.192665:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b889ac7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc598 expref: 14 pid: 6522 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683493.192681:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850208128:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789683493.192906:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865ea180 going to sleep for 11 seconds 00000100:00100000:3.0:1789683493.196920:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683493.197241:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850208128:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789683493.197283:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889c87 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683493.197586:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835445504 00000100:00100000:0.0:1789683493.197595:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835445504 00010000:00010000:0.0:1789683493.197633:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b889ac7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc598 expref: 15 pid: 6522 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683493.197666:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 62 00000100:00100000:0.0:1789683493.197676:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb29f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+15:2402:x1876618835445504:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683493.197692:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683493.197699:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b889ac7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc598 expref: 15 pid: 6522 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.197708:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b889ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc598 expref: 15 pid: 6522 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.197725:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b889ac7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc598 expref: 15 pid: 6522 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.197739:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:0.0:1789683493.197743:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889c87 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.197764:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889c87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.197773:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889c87 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.197842:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683493.197867:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889c87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.197873:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889c87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683493.197896:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb29f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+14:2402:x1876618835445504:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 221us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683493.197903:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 62 00010000:00010000:3.0:1789683493.198057:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889c8e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.198070:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889c48 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5fa expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.198085:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889c8e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.198113:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889c48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5fa expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.198125:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889c48 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5fa expref: 14 pid: 6522 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683493.198139:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84416300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850208256:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789683493.199363:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb510e780 going to sleep for 11 seconds 00000100:00100000:2.0:1789683493.211296:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84416300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850208256:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683493.211331:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889c8e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683493.217086:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683493.217319:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835445632 00000100:00100000:1.0:1789683493.217330:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835445632 00010000:00010000:1.0:1789683493.217370:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889c48 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5fa expref: 15 pid: 6522 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683493.217418:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:1.0:1789683493.217429:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83773b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+15:2404:x1876618835445632:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683493.217444:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683493.217451:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889c48 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5fa expref: 15 pid: 6522 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.217478:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889c48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5fa expref: 15 pid: 6522 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.217502:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889c48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5fa expref: 15 pid: 6522 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.217516:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0f83e0bf00) 00010000:00010000:1.0:1789683493.217522:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889c8e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.217532:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889c8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.217539:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889c8e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.217580:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683493.217619:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889c8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683493.217633:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889c8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683493.217636:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83773b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+14:2404:x1876618835445632:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 209us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683493.217643:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 63 00000001:00080000:2.0:1789683493.217752:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1789683493.217918:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1789683493.217956:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1789683493.218030:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f18700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876618850208384:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789683493.218075:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683493.218108:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc0775180 going to sleep for 11 seconds 00000100:00100000:1.0:1789683493.218348:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850208384 00000100:00100000:1.0:1789683493.218354:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850208384 00000100:00100000:1.0:1789683493.218399:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789683493.218407:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1876618850208384:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789683493.218488:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1876618850208384:12345-0@lo:1000:mdt00_000.0 Request processed in 82us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683493.218495:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789683493.218649:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f18700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876618850208384:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789683493.218765:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1789683493.218840:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f18700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876618850208512:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789683493.218866:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683493.218887:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e835a5480 going to sleep for 11 seconds 00000100:00100000:0.0:1789683493.218992:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850208512 00000100:00100000:0.0:1789683493.218997:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850208512 00000100:00100000:0.0:1789683493.219033:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789683493.219041:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1876618850208512:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789683493.219159:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6521:x1876618850208512:12345-0@lo:1000:mdt00_000.0 Request processed in 118us (291us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789683493.219166:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789683493.219196:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f18700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876618850208512:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789683493.219237:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889c8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.219247:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889c8e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.219254:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889c8e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.219259:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683493.219273:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889c8e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.219281:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889c8e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.219295:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0f83e0bf00) 00010000:00010000:1.0:1789683493.219298:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789683493.219302:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889c8e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.219308:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889c8e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.219338:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889bbc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.219344:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889bbc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.219350:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889bbc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.219363:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683493.219366:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889bbc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.219371:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889bbc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.219380:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:1.0:1789683493.219383:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789683493.219385:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889bbc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.219391:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889bbc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.219412:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b889c95 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.219424:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889bd8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5de expref: 17 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.219432:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b889c95 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.219455:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5de expref: 17 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683493.219469:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889bd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5de expref: 17 pid: 12533 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683493.219491:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850208640:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789683493.219567:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865ea180 going to sleep for 11 seconds 00000100:00100000:2.0:1789683493.223238:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850208640:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683493.223277:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b889c95 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683493.223716:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683493.223825:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835445760 00000100:00100000:3.0:1789683493.223873:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835445760 00010000:00010000:3.0:1789683493.223910:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889bd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5de expref: 18 pid: 12533 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683493.223945:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:3.0:1789683493.223955:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83770a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+18:2402:x1876618835445760:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683493.223969:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683493.223975:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889bd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5de expref: 18 pid: 12533 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.223987:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5de expref: 18 pid: 12533 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.224008:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889bd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc5de expref: 18 pid: 12533 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.224034:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:3.0:1789683493.224039:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b889c95 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.224049:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b889c95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.224057:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b889c95 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.224081:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683493.224136:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83770a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+17:2402:x1876618835445760:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 182us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683493.224144:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 64 00010000:00010000:0.0:1789683493.224740:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b889c95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.224750:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b889c95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.224763:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b889c95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.224770:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b889c95 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.224821:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b889c95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.224828:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837daa00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683493.224832:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b889c95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.224840:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b889c95 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.224851:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:0.0:1789683493.224855:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683493.224858:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b889c95 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.224864:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b889c95 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.224875:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889c87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.224881:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889c87 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.224886:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889c87 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.224892:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dac00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683493.224894:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889c87 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.224912:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889c87 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.224921:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0fb8504100) 00010000:00010000:0.0:1789683493.224923:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789683493.224926:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889c87 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683493.224932:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889c87 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683493.225097:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+16:11293:x1876618835445376:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 32642us (32846us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789683493.225107:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 93 00000020:00080000:0.0:1789683493.225111:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789683493.225310:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683493.225316:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683493.225332:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789683493.225340:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789683493.227983:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683493.228937:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835446016 00000100:00100000:3.0:1789683493.228950:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835446016 00000100:00100000:3.0:1789683493.228998:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:3.0:1789683493.229008:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+16:11293:x1876618835446016:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789683493.229246:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789683493.229294:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1789683493.229323:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b889c9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.229339:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b889c9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.229351:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b889c9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.229370:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b889c9c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.229376:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b889c9c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.229381:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b889c9c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.229399:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789683493.229478:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+18:11293:x1876618835446016:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 470us (1504us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789683493.229485:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000020:00080000:3.0:1789683493.229490:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789683493.229508:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683493.229514:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b889c9c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.229521:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177e00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683493.229525:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b889c9c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.229534:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b889c9c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.229545:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0f83e0bf00) 00010000:00010000:3.0:1789683493.229548:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789683493.229552:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b889c9c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.229567:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b889c9c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683493.229577:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683493.229578:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683493.229580:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683493.920243:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683493.983174:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850208768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683493.983260:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683493.983418:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850208768 00000100:00100000:1.0:1789683493.983427:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850208768 00000100:00100000:1.0:1789683493.983493:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789683493.983503:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850208768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789683493.983535:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683493.983583:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850208768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683493.983589:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1789683493.983721:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683493.983761:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850208768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683494.496209:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850208896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683494.496300:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683494.496475:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850209152:0@lo:400:kworker.0 00000100:00100000:1.0:1789683494.496509:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683494.503551:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850208896 00000100:00100000:2.0:1789683494.503572:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850208896 00000100:00100000:2.0:1789683494.503675:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789683494.503686:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876618850208896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683494.503714:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683494.503825:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876618850208896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (7524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683494.503832:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789683494.503883:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850209024:0@lo:400:kworker.0 00000100:00100000:2.0:1789683494.503927:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683494.504943:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850209152 00000100:00100000:0.0:1789683494.504954:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850209152 00000100:00100000:0.0:1789683494.505009:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789683494.505020:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850209152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683494.505093:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850209152:12345-0@lo:400:kworker.0 Request processed in 76us (8583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683494.505101:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:3.0:1789683494.507728:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683494.507763:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850209280:0@lo:400:kworker.0 00000100:00100000:3.0:1789683494.507962:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683494.508026:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850209792:0@lo:400:kworker.0 00000100:00100000:3.0:1789683494.508052:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683494.508071:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850210304:0@lo:400:kworker.0 00000100:00100000:3.0:1789683494.508092:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683494.508138:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850209792 00000100:00100000:3.0:1789683494.508146:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850209792 00000100:00100000:3.0:1789683494.508190:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850210304 00000100:00100000:3.0:1789683494.508192:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850210304 00000100:00100000:3.0:1789683494.508214:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789683494.508223:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850209792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683494.508290:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850209792:12345-0@lo:400:kworker.0 Request processed in 67us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683494.508315:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789683494.508334:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789683494.508340:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850210304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683494.508387:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850210304:12345-0@lo:400:kworker.0 Request processed in 46us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683494.508393:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:3.0:1789683494.508410:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789683494.508538:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850209280 00000100:00100000:0.0:1789683494.508543:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850209280 00000100:00100000:0.0:1789683494.508578:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789683494.508585:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850209280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683494.508624:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850209280:12345-0@lo:400:kworker.0 Request processed in 40us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683494.508638:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00010000:00080000:3.0:1789683494.510034:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e8445d880 x1876618850209792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683494.510051:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850209792:0@lo:400:kworker.0 00010000:00080000:3.0:1789683494.510074:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e8445ed80 x1876618850210304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683494.510083:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850210304:0@lo:400:kworker.0 00000100:00100000:3.0:1789683494.510110:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850209280:0@lo:400:kworker.0 00000100:00100000:3.0:1789683494.510157:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850208896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683494.510175:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850209408:0@lo:400:kworker.0 00000100:00100000:3.0:1789683494.510221:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683494.510267:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850209408 00000100:00100000:3.0:1789683494.510274:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850209408 00000100:00100000:3.0:1789683494.510313:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789683494.510320:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850209408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683494.510363:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850209408:12345-0@lo:400:kworker.0 Request processed in 44us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683494.510384:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789683494.510418:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850209408:0@lo:400:kworker.0 00000100:00100000:3.0:1789683494.510426:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850209920:0@lo:400:kworker.0 00000100:00100000:3.0:1789683494.510605:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683494.510630:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850209920 00000100:00100000:3.0:1789683494.510634:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850209920 00000100:00100000:3.0:1789683494.510668:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789683494.510675:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850209920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683494.510779:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850209920:12345-0@lo:400:kworker.0 Request processed in 30us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683494.510803:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1789683494.510820:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683494.510843:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850209920:0@lo:400:kworker.0 00000100:00100000:3.0:1789683494.510885:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850209024 00000100:00100000:3.0:1789683494.510890:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850209024 00000100:00100000:3.0:1789683494.510914:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1789683494.510920:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850209024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683494.510952:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850209024:12345-0@lo:400:kworker.0 Request processed in 33us (7025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683494.510958:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789683494.511833:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850209152:0@lo:400:kworker.0 00000100:00100000:1.0:1789683494.511846:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850209664:0@lo:400:kworker.0 00000100:00100000:1.0:1789683494.511884:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683494.511913:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850210176:0@lo:400:kworker.0 00000100:00100000:1.0:1789683494.511933:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683494.512017:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850209664 00000100:00100000:3.0:1789683494.512023:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850209664 00000100:00100000:3.0:1789683494.512071:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850210176 00000100:00100000:3.0:1789683494.512075:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850210176 00000100:00100000:3.0:1789683494.512097:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789683494.512106:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850209664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683494.512165:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850209664:12345-0@lo:400:kworker.0 Request processed in 61us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683494.512173:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789683494.512186:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789683494.512193:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850210176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683494.512219:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850210176:12345-0@lo:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683494.512225:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:1.0:1789683494.512299:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683494.512321:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850209664:0@lo:400:kworker.0 00000100:00100000:1.0:1789683494.512340:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850210176:0@lo:400:kworker.0 00000100:00100000:2.0:1789683494.512650:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850209024:0@lo:400:kworker.0 00000100:00100000:2.0:1789683494.512659:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850209536:0@lo:400:kworker.0 00000100:00100000:2.0:1789683494.512694:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683494.512888:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850210048:0@lo:400:kworker.0 00000100:00100000:2.0:1789683494.512932:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683494.513027:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850210048 00000100:00100000:3.0:1789683494.513032:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850210048 00000100:00100000:3.0:1789683494.513083:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789683494.513091:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3648:x1876618850210048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683494.513133:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3648:x1876618850210048:12345-0@lo:400:kworker.0 Request processed in 44us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683494.513140:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789683494.513167:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850210048:0@lo:400:kworker.0 00000100:00080000:0.0:1789683494.513264:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683494.513294:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850209536 00000100:00100000:1.0:1789683494.513298:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850209536 00000100:00100000:1.0:1789683494.513360:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789683494.513368:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850209536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683494.513420:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850209536:12345-0@lo:400:kworker.0 Request processed in 53us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683494.513426:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789683494.513490:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850209536:0@lo:400:kworker.0 00010000:00010000:2.0:1789683494.943185:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789683495.056039:0:14266:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789683495.056050:0:14266:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789683495.056085:0:14266:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789683495.056094:0:14266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789683495.271709:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683495.271757:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835446272 00000100:00100000:0.0:1789683495.271776:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835446272 00000100:00100000:0.0:1789683495.271868:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 94 00000100:00100000:0.0:1789683495.271881:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+18:11312:x1876618835446272:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789683495.271907:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683495.271927:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b889ca3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc616 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.272032:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c800/0xcf8485587b889caa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.272047:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c800/0xcf8485587b889caa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.272062:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c800/0xcf8485587b889caa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683495.272075:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789683495.272188:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b889ca3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc616 expref: 21 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.272203:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c800/0xcf8485587b889caa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc616 expref: 20 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.272220:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:0.0:1789683495.272223:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789683495.272235:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454c800, rc 0) 00000100:00100000:0.0:1789683495.272305:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+20:11312:x1876618835446272:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 426us (618us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789683495.272312:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 94 00000100:00080000:0.0:1789683495.272337:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683495.281901:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683495.282021:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835446400 00000100:00100000:0.0:1789683495.282032:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835446400 00000100:00100000:0.0:1789683495.282089:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 95 00000100:00100000:0.0:1789683495.282100:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+20:11312:x1876618835446400:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:0.0:1789683495.282195:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889cb8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282215:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889cb8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282238:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889cb8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282254:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889cbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282270:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889cbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282278:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889cbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282378:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282386:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282394:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789683495.282437:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282449:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889cb8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282456:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889cb8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282463:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889cb8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282469:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454c000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683495.282473:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889cb8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282481:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889cb8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282491:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:0.0:1789683495.282494:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683495.282498:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889cb8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282646:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889cb8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282665:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889cbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282671:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889cbf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282676:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889cbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282681:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683495.282684:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889cbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282690:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889cbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282697:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0e835a6800) 00010000:00010000:0.0:1789683495.282700:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683495.282702:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889cbf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282708:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889cbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282722:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282727:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cc6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282737:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282741:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454dc00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683495.282743:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282748:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282754:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0e835a6e00) 00010000:00010000:0.0:1789683495.282756:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683495.282758:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cc6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.282763:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683495.282866:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+20:11312:x1876618835446400:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 765us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683495.282874:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 95 00000100:00100000:0.0:1789683495.328270:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683495.328347:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835446656 00000100:00100000:2.0:1789683495.328360:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835446656 00000100:00100000:2.0:1789683495.328432:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 96 00000100:00100000:2.0:1789683495.328444:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+20:11315:x1876618835446656:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683495.328471:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683495.328496:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889ccd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc61d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.328580:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889cd4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.328606:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889cd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.328619:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889cd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.328638:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889cdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.328681:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889cdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.328698:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889cdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.328862:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889ce2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.328871:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.328879:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683495.328889:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789683495.329073:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889cd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.329079:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889cd4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.329084:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889cd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.329088:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683495.329091:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889cd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.329097:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889cd4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.329115:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:2.0:1789683495.329117:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683495.329121:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889cd4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.329126:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889cd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.329136:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889cdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.329139:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889cdb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.329143:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889cdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.329146:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683495.329148:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889cdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.329151:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889cdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.329155:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0f853e3900) 00010000:00010000:2.0:1789683495.329156:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683495.329157:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889cdb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.329160:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b889cdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.329199:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889ccd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc61d expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.329221:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc61d expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.329234:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0f853e3c00) 00010000:00010000:2.0:1789683495.329236:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683495.329239:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31200, rc 0) 00000100:00100000:2.0:1789683495.329362:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+22:11315:x1876618835446656:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 919us (1113us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789683495.329370:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 96 00000100:00100000:1.0:1789683495.331612:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683495.331745:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835446784 00000100:00100000:0.0:1789683495.331755:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835446784 00000100:00100000:0.0:1789683495.332005:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 97 00000100:00100000:0.0:1789683495.332017:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+22:11315:x1876618835446784:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:0.0:1789683495.332095:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cf0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.332133:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.332144:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.332181:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.332187:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cf0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.332193:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.332199:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454dc00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683495.332218:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.332233:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cf0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.332244:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0f853e3c00) 00010000:00010000:0.0:1789683495.332247:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789683495.332251:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cf0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.332257:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889cf0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683495.332350:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+22:11315:x1876618835446784:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 334us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683495.332365:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 97 00000100:00100000:2.0:1789683495.336747:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683495.336868:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835447040 00000100:00100000:3.0:1789683495.336878:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835447040 00000100:00100000:3.0:1789683495.336929:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:3.0:1789683495.336937:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f867cb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+22:11315:x1876618835447040:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789683495.337153:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f867cb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+23:11315:x1876618835447040:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 217us (414us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1789683495.337159:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:1.0:1789683495.389076:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683495.389150:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835447296 00000100:00100000:3.0:1789683495.389162:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835447296 00000100:00100000:3.0:1789683495.389243:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 98 00000100:00100000:3.0:1789683495.389255:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+23:10833:x1876618835447296:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789683495.389289:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683495.389311:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889cf7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc624 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.390402:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889cfe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.390426:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889ce2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc61d expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.390435:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889cfe lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.390479:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc61d expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.390497:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889ce2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc61d expref: 24 pid: 6523 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683495.390534:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f16300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1876618850210432:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683495.390661:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f845d3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683495.398468:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f16300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1876618850210432:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683495.398510:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889cfe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683495.398594:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683495.398676:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835447424 00000100:00100000:2.0:1789683495.398684:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835447424 00010000:00010000:2.0:1789683495.398732:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889ce2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc61d expref: 25 pid: 6523 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683495.398773:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:2.0:1789683495.398805:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+25:2402:x1876618835447424:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683495.398823:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683495.398831:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889ce2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc61d expref: 25 pid: 6523 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.398845:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc61d expref: 25 pid: 6523 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.398867:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889ce2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc61d expref: 25 pid: 6523 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.398882:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0f853e3c00) 00010000:00010000:2.0:1789683495.398888:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889cfe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.398916:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889cfe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.398924:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889cfe lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.398947:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683495.399009:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+24:2402:x1876618835447424:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 227us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683495.399017:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 65 00010000:00010000:0.0:1789683495.399142:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889cfe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.399150:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889cfe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683495.399172:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789683495.399332:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889cf7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc624 expref: 25 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.399348:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889cfe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc624 expref: 24 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.399356:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0f853e3c00) 00010000:00010000:0.0:1789683495.399358:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789683495.399361:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31600, rc 0) 00000100:00100000:0.0:1789683495.399390:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+24:10833:x1876618835447296:12345-192.168.201.50@tcp:101:bash.0 Request processed in 10138us (10323us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1789683495.399397:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 98 00000100:00100000:3.0:1789683495.404362:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683495.404923:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835447552 00000100:00100000:2.0:1789683495.404934:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835447552 00000100:00100000:2.0:1789683495.404995:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 99 00000100:00100000:2.0:1789683495.405005:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+24:10833:x1876618835447552:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683495.405033:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683495.405056:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889d0c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc62b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.405092:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889d13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.405108:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889d13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.405121:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889d13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.405249:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889d0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc62b expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.405282:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889d13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc62b expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.405290:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0f853e3c00) 00010000:00010000:2.0:1789683495.405293:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789683495.405297:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30600, rc 0) 00000100:00100000:2.0:1789683495.405455:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+25:10833:x1876618835447552:12345-192.168.201.50@tcp:101:bash.0 Request processed in 450us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683495.405462:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 99 00000100:00100000:2.0:1789683495.409367:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683495.409501:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835447808 00000100:00100000:0.0:1789683495.409572:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835447808 00000100:00100000:0.0:1789683495.409680:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 100 00000100:00100000:0.0:1789683495.409751:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+25:10833:x1876618835447808:12345-192.168.201.50@tcp:36:bash.0 00010000:00010000:0.0:1789683495.410171:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889d1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.410192:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889d1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.410220:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889d1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789683495.410280:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1789683495.410304:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abb5c7f0 reply state 00000000eb9b41ca transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889d1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.410318:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889d1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.410326:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0f853e3c00) 00010000:00010000:0.0:1789683495.410329:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789683495.410333:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789683495.410371:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1789683495.410614:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+29:10833:x1876618835447808:12345-192.168.201.50@tcp:36:bash.0 Request processed in 921us (1257us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789683495.410621:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 100 00000020:00080000:0.0:1789683495.410626:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789683495.412939:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683495.413066:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835447936 00000100:00100000:2.0:1789683495.413077:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835447936 00000100:00100000:2.0:1789683495.413143:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 101 00000100:00100000:2.0:1789683495.413154:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+29:10833:x1876618835447936:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683495.413178:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683495.413198:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b889d21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc632 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.413263:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b889d21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc632 expref: 30 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.413278:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b889d21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc632 expref: 30 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.413295:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0f853e3c00) 00010000:00010000:2.0:1789683495.413311:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683495.413315:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31800, rc 0) 00000100:00100000:2.0:1789683495.413372:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+30:10833:x1876618835447936:12345-192.168.201.50@tcp:101:bash.0 Request processed in 220us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683495.413378:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 101 00000100:00100000:2.0:1789683495.417114:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683495.417209:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835448064 00000100:00100000:3.0:1789683495.417220:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835448064 00000100:00100000:3.0:1789683495.417309:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00100000:3.0:1789683495.417321:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:10833:x1876618835448064:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789683495.417341:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683495.417365:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c163d194/0xcf8485587b889d28 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc639 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683495.417393:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aac6724, atime: 0x6aac6722, ctime: 0x6aac6724, blocks: 0x8 00010000:00010000:3.0:1789683495.417420:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1789683495.417425:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683495.417435:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c163d194/0xcf8485587b889d28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc639 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.417454:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c163d194/0xcf8485587b889d28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc639 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.417468:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6177e00, rc 0) 00000100:00100000:3.0:1789683495.417553:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+7:10833:x1876618835448064:12345-192.168.201.50@tcp:101:bash.0 Request processed in 234us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683495.417559:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00080000:1.0:1789683495.418317:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683495.421449:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683495.423418:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835448192 00000100:00100000:3.0:1789683495.423434:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835448192 00002000:00010000:3.0:1789683495.423488:0:8443:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1789683495.423495:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e8445ce00 with x1876618835448192 ext(0->18446744073709551615) 00002000:00010000:3.0:1789683495.423624:0:8443:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0e8445ce00. 00000100:00100000:3.0:1789683495.423710:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:3.0:1789683495.423721:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec036ece-1720-411a-849c-c978dbb41f8a+7:2405:x1876618835448192:12345-192.168.201.50@tcp:10:bash.0 00002000:00010000:3.0:1789683495.424039:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789683495.424043:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789683492 -> 1789683495 00002000:00010000:3.0:1789683495.424046:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789683490 -> 1789683490 00002000:00010000:3.0:1789683495.424049:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789683492 -> 1789683495 00002000:00010000:3.0:1789683495.424051:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1789683495.424145:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec036ece-1720-411a-849c-c978dbb41f8a+8:2405:x1876618835448192:12345-192.168.201.50@tcp:10:bash.0 Request processed in 425us (2708us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789683495.424153:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 1 00002000:00010000:3.0:1789683495.424156:0:8443:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1789683495.424159:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e8445ce00 with x1876618835448192 ext(0->18446744073709551615) 00002000:00010000:3.0:1789683495.424163:0:8443:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0e8445ce00. 00000100:00100000:3.0:1789683495.445253:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683495.445305:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683495.445409:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835448448 00000100:00100000:1.0:1789683495.445420:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835448448 00000100:00100000:1.0:1789683495.445471:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 42 00000100:00100000:1.0:1789683495.445480:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+8:2402:x1876618835448448:12345-192.168.201.50@tcp:16:kworker.0 00000100:00100000:0.0:1789683495.445611:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835448320 00000100:00100000:0.0:1789683495.445615:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835448320 00002000:00100000:0.0:1789683495.445639:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->7) req@ffff9f0e84414a80 x1876618835448320/t0(0) o4->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:551/0 lens 496/0 e 0 to 0 dl 1789683506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789683495.445649:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e84414a80 with x1876618835448320 ext(0->7) 00002000:00010000:0.0:1789683495.445654:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0e84414a80 00000100:00100000:0.0:1789683495.445677:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:0.0:1789683495.445683:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec036ece-1720-411a-849c-c978dbb41f8a+9:2402:x1876618835448320:12345-192.168.201.50@tcp:4:bash.0 00000100:00100000:3.0:1789683495.447630:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec036ece-1720-411a-849c-c978dbb41f8a+11:2402:x1876618835448320:12345-192.168.201.50@tcp:4:bash.0 Request processed in 1939us (2381us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789683495.447642:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 2 00002000:00100000:3.0:1789683495.447661:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->7) req@ffff9f0e84414a80 x1876618835448320/t4294967308(0) o4->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:551/0 lens 496/448 e 0 to 0 dl 1789683506 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789683495.447671:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e84414a80 with x1876618835448320 ext(0->7) 00002000:00010000:3.0:1789683495.447677:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0e84414a80 00000001:00080000:2.0:1789683495.448449:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1789683495.448466:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:1.0:1789683495.448610:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835448448:12345-192.168.201.50@tcp:16:kworker.0 Request processed in 3128us (3302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683495.448619:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 42 00000100:00100000:3.0:1789683495.504058:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683495.504325:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835448576 00000100:00100000:0.0:1789683495.504338:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835448576 00000100:00100000:0.0:1789683495.504431:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 102 00000100:00100000:0.0:1789683495.504441:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+30:11329:x1876618835448576:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:0.0:1789683495.504555:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b889d2f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504575:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b889d2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504589:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b889d2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504605:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504613:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504620:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504718:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889d3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504728:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889d3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504735:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889d3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789683495.504851:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889d3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504862:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b889d2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504875:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b889d2f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504883:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b889d2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504890:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454cc00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683495.504895:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b889d2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504904:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b889d2f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504917:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:0.0:1789683495.504920:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683495.504926:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b889d2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504932:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b889d2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504947:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504953:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504960:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504975:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683495.504985:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.504993:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.505000:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0e835a6e00) 00010000:00010000:0.0:1789683495.505003:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683495.505006:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.505012:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.505030:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889d3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.505037:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889d3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.505042:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889d3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.505047:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454c000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683495.505050:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889d3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.505055:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889d3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.505062:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0f853e3c00) 00010000:00010000:0.0:1789683495.505065:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683495.505075:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889d3d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.505081:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b889d3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683495.505174:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+30:11329:x1876618835448576:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 732us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683495.505182:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 102 00000100:00100000:0.0:1789683495.554197:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683495.554382:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835448832 00000100:00100000:2.0:1789683495.554393:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835448832 00000100:00100000:2.0:1789683495.554467:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 103 00000100:00100000:2.0:1789683495.554478:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+30:11332:x1876618835448832:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683495.554502:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683495.554533:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889d44 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc640 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.554615:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889d4b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.554631:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889d4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.554643:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889d4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.554659:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889d52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.554665:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889d52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.554703:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889d52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555202:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889d59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555214:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889d59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555231:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889d59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683495.555244:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789683495.555330:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889d4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555338:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889d4b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555344:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889d4b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555350:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683495.555355:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889d4b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555365:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889d4b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555379:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:2.0:1789683495.555382:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683495.555396:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889d4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555403:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b889d4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555418:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889d52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555425:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889d52 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555431:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889d52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555437:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683495.555440:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889d52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555446:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889d52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555756:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0f85396400) 00010000:00010000:2.0:1789683495.555861:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683495.555866:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889d52 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555872:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889d52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555943:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b889d44 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc640 expref: 33 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555972:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889d59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc640 expref: 32 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.555980:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0f853e3c00) 00010000:00010000:2.0:1789683495.555982:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789683495.555985:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31c00, rc 0) 00000100:00100000:2.0:1789683495.556191:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+32:11332:x1876618835448832:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 1714us (2002us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789683495.556201:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 103 00000100:00100000:1.0:1789683495.561326:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683495.561421:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835448960 00000100:00100000:0.0:1789683495.561434:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835448960 00000100:00100000:0.0:1789683495.561926:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 104 00000100:00100000:0.0:1789683495.561938:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+32:11332:x1876618835448960:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:0.0:1789683495.562017:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.562035:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889cfe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc624 expref: 32 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.562045:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d67 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.562081:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889cfe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc624 expref: 32 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.562096:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889cfe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc624 expref: 32 pid: 8462 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683495.562112:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83772680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850210560:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789683495.562246:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683495.568675:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683495.568825:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835449216 00000100:00100000:1.0:1789683495.568835:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835449216 00000100:00100000:1.0:1789683495.568895:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:1.0:1789683495.568905:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+33:6173:x1876618835449216:12345-192.168.201.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789683495.569208:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+34:6173:x1876618835449216:12345-192.168.201.50@tcp:35:ldlm_bl.0 Request processed in 302us (541us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789683495.569216:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:3.0:1789683495.572463:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83772680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850210560:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789683495.572501:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683495.573202:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683495.573325:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835449344 00000100:00100000:3.0:1789683495.573339:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835449344 00010000:00010000:3.0:1789683495.573391:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889cfe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc624 expref: 34 pid: 8462 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683495.573542:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 66 00000100:00100000:3.0:1789683495.573554:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+34:2402:x1876618835449344:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683495.573571:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683495.573580:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889cfe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc624 expref: 34 pid: 8462 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.573594:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889cfe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc624 expref: 34 pid: 8462 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.573621:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b889cfe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc624 expref: 34 pid: 8462 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.573640:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0f853e3c00) 00010000:00010000:3.0:1789683495.573657:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.573668:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.573676:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d67 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.573966:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683495.574044:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+33:2402:x1876618835449344:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 491us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683495.574054:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 66 00010000:00010000:1.0:1789683495.575366:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.575384:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.575435:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.575444:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d67 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.575589:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.575598:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683495.575602:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.575609:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.575628:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0f853e3c00) 00010000:00010000:1.0:1789683495.575632:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789683495.575638:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d67 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.575644:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889d67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683495.576009:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+32:11332:x1876618835448960:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 14068us (15562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683495.576018:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 104 00000100:00100000:2.0:1789683495.581215:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683495.581312:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835449600 00000100:00100000:1.0:1789683495.581323:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835449600 00000100:00100000:1.0:1789683495.581413:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:1.0:1789683495.581423:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+32:11332:x1876618835449600:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:1.0:1789683495.581812:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+33:11332:x1876618835449600:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 389us (605us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789683495.581820:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:0.0:1789683495.664262:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683495.664383:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835449856 00000100:00100000:3.0:1789683495.664395:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835449856 00000100:00100000:3.0:1789683495.664721:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 105 00000100:00100000:3.0:1789683495.664734:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+33:11343:x1876618835449856:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:3.0:1789683495.664759:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683495.664781:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889d6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc647 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.664899:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d75 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.664915:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.664928:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.664942:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.665638:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.665652:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.665774:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889d83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.665809:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889d83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.665817:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889d83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683495.665828:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1789683495.665925:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.665933:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d75 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.665939:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.665945:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683495.665949:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.665956:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d75 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.666053:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:3.0:1789683495.666057:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683495.666063:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d75 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.666070:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.666086:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.666092:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.666097:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.666102:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683495.666105:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.666111:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.666117:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0e826a2000) 00010000:00010000:3.0:1789683495.666120:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683495.666123:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d7c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.666128:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.666184:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889d6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc647 expref: 36 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.666198:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889d83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc647 expref: 35 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.666205:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0f853e3c00) 00010000:00010000:3.0:1789683495.666207:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683495.666210:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176400, rc 0) 00000100:00100000:3.0:1789683495.666300:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+35:11343:x1876618835449856:12345-192.168.201.50@tcp:101:cat.0 Request processed in 1569us (2047us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789683495.666308:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 105 00000100:00100000:0.0:1789683495.671134:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683495.671285:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835450112 00000100:00100000:2.0:1789683495.671296:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835450112 00000100:00100000:2.0:1789683495.671396:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:2.0:1789683495.671407:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+35:11343:x1876618835450112:12345-192.168.201.50@tcp:35:cat.0 00000100:00100000:2.0:1789683495.671709:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+36:11343:x1876618835450112:12345-192.168.201.50@tcp:35:cat.0 Request processed in 303us (585us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789683495.671718:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:0.0:1789683495.697338:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683495.699249:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835450368 00000100:00100000:2.0:1789683495.699272:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835450368 00000100:00100000:3.0:1789683495.702094:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 106 00000100:00100000:3.0:1789683495.702110:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+36:11344:x1876618835450368:12345-192.168.201.50@tcp:36:rm.0 00010000:00010000:3.0:1789683495.702177:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1789683495.702205:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b889d21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc632 expref: 36 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.702240:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889d83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc647 expref: 35 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.702254:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889d59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc640 expref: 34 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.702266:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889d13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc62b expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.702294:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0f853e3c00) 00010000:00010000:3.0:1789683495.702299:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683495.702322:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889d91 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.702335:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889d91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.702345:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889d91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.702360:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.702368:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.702374:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.702565:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d9f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.702574:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.702581:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789683495.702848:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1789683495.702859:0:8462:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 409752074337ns, next at 410752071444ns, rc = 0 00010000:00010000:3.0:1789683495.702913:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b889da6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.702923:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b889da6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.702930:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b889da6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.702937:0:8462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b889da6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.702942:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b889da6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.702948:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b889da6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.704645:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683495.704684:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.704695:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d9f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.704701:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d9f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.704706:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683495.704710:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d9f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.704718:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d9f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.704747:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0f853e3c00) 00010000:00010000:3.0:1789683495.704750:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789683495.704755:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d9f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.704762:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889d9f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.704799:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889d91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.704807:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889d91 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.704812:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889d91 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.704818:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683495.704820:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889d91 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.704825:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889d91 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.704832:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:3.0:1789683495.704835:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683495.704837:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889d91 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.704842:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889d91 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683495.704862:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000830071f0 reply state 0000000053f3cd88 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.704874:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.704881:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0e826a2000) 00010000:00010000:3.0:1789683495.704883:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789683495.704886:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789683495.705574:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+34:11344:x1876618835450368:12345-192.168.201.50@tcp:36:rm.0 Request processed in 3462us (8240us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1789683495.705585:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 106 00010000:00010000:1.0:1789683495.705677:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683495.705685:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b889da6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.705693:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683495.705697:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b889da6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.705705:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b889da6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.705718:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0f853e3c00) 00010000:00010000:1.0:1789683495.705721:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789683495.705724:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b889da6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.705729:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b889da6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.705756:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683495.705758:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683495.705760:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683495.769902:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683495.770010:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835450624 00000100:00100000:1.0:1789683495.770024:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835450624 00000100:00100000:1.0:1789683495.770102:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 107 00000100:00100000:1.0:1789683495.770113:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+34:11350:x1876618835450624:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:1.0:1789683495.770138:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683495.770159:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889dad lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc64e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.770314:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889db4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.770333:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889db4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.770347:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889db4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.770360:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889dbb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.770367:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889dbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.770375:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889dbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789683495.770813:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789683495.770977:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889dc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.770988:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.770996:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.771030:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889db4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.771037:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889db4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.771044:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889db4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.771050:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837db600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683495.771055:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889db4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.771063:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889db4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.771075:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:1.0:1789683495.771078:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683495.771082:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889db4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.771088:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889db4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789683495.771112:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f45caea8 reply state 00000000baa9a67f transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889dbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.771124:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889dbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.771131:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0e826a2000) 00010000:00010000:1.0:1789683495.771133:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789683495.771136:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789683495.771164:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889dad lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc64e expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.771177:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc64e expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.771184:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0fb8504800) 00010000:00010000:1.0:1789683495.771187:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683495.771189:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da200, rc 0) 00000100:00100000:1.0:1789683495.771270:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+37:11350:x1876618835450624:12345-192.168.201.50@tcp:101:bash.0 Request processed in 1158us (1380us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789683495.771278:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 107 00000100:00100000:2.0:1789683495.776993:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683495.777107:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835450752 00000100:00100000:0.0:1789683495.777118:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835450752 00000100:00100000:0.0:1789683495.777196:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:0.0:1789683495.777206:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec036ece-1720-411a-849c-c978dbb41f8a+7:2403:x1876618835450752:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789683495.777235:0:8676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683495.777259:0:8676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b889dd0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc655 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789683495.777289:0:8676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00080000:1.0:1789683495.777299:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789683495.777310:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1789683495.777314:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683495.777324:0:8676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b889dd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc655 expref: 8 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.777344:0:8676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b889dd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc655 expref: 8 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.777357:0:8676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d400, rc 0) 00000100:00100000:0.0:1789683495.777420:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec036ece-1720-411a-849c-c978dbb41f8a+8:2403:x1876618835450752:12345-192.168.201.50@tcp:101:bash.0 Request processed in 215us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683495.777443:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:0.0:1789683495.782115:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683495.782255:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835450880 00000100:00100000:2.0:1789683495.782266:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835450880 00000100:00100000:2.0:1789683495.782325:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 44 00000100:00100000:2.0:1789683495.782337:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+8:11350:x1876618835450880:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683495.782372:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683495.782394:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b889dd7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc65c expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.782426:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b889dd0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc655 expref: 9 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.782435:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683495.782439:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683495.782445:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b889dd7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc65c expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.782493:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b889dd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc655 expref: 9 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.782507:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b889dd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc655 expref: 9 pid: 8676 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683495.782523:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1876618850210688:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683495.782630:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f845d3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683495.785547:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1876618850210688:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683495.785591:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b889dd7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc65c expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.785618:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31200, rc 0) 00000100:00100000:2.0:1789683495.785702:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+9:11350:x1876618835450880:12345-192.168.201.50@tcp:101:bash.0 Request processed in 3365us (3596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683495.785711:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 44 00000100:00100000:0.0:1789683495.787489:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683495.787726:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835451008 00000100:00100000:2.0:1789683495.787737:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835451008 00010000:00010000:2.0:1789683495.787821:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b889dd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc655 expref: 9 pid: 8676 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683495.787875:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:2.0:1789683495.787897:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83771c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+9:2402:x1876618835451008:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683495.787918:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683495.787951:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b889dd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc655 expref: 9 pid: 8676 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.787967:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b889dd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc655 expref: 9 pid: 8676 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.788001:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b889dd0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc655 expref: 9 pid: 8676 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.788020:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683495.788025:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683495.788034:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b889dd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc65c expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.788045:0:10343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b889dd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc65c expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683495.788106:0:10343:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b889dd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc65c expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683495.788123:0:10343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10343:1876618850210816:192.168.201.50@tcp:105: 00000100:00100000:2.0:1789683495.788448:0:10343:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f845d3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683495.802117:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683495.802293:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835451264 00000100:00100000:1.0:1789683495.802302:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835451264 00000100:00100000:1.0:1789683495.802378:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:1.0:1789683495.802389:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+37:11350:x1876618835451264:12345-192.168.201.50@tcp:35:bash.0 00000100:00100000:1.0:1789683495.802737:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+38:11350:x1876618835451264:12345-192.168.201.50@tcp:35:bash.0 Request processed in 348us (630us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1789683495.802769:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:2.0:1789683495.805308:0:10343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10343:1876618850210816:192.168.201.50@tcp:105: 00010000:00010000:2.0:1789683495.805338:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683495.805406:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83771c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+8:2402:x1876618835451008:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 17510us (17926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683495.805417:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:0.0:1789683495.948494:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683495.948833:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835451392 00000100:00100000:3.0:1789683495.948845:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835451392 00000100:00100000:3.0:1789683495.948909:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 108 00000100:00100000:3.0:1789683495.948921:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+38:11366:x1876618835451392:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789683495.948949:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683495.948971:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889dde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc663 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.949044:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889de5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.949060:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889de5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.949073:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889de5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683495.949136:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789683495.949141:0:12533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789683495.949159:0:12533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889de5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.949186:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889dde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc663 expref: 40 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.949204:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889de5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc663 expref: 39 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.949212:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:3.0:1789683495.949227:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789683495.949231:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6177200, rc 0) 00000100:00100000:3.0:1789683495.949300:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+39:11366:x1876618835451392:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 382us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683495.949308:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 108 00000100:00100000:0.0:1789683495.953425:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683495.953641:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835451648 00000100:00100000:3.0:1789683495.953652:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835451648 00000100:00100000:3.0:1789683495.953851:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 109 00000100:00100000:3.0:1789683495.953862:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+39:11366:x1876618835451648:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789683495.953884:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683495.953904:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889dec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc66a expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.954007:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b889df3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.954042:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b889df3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.954057:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b889df3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683495.954069:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789683495.954169:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889dec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc66a expref: 42 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.954187:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b889df3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc66a expref: 41 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.954196:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0fb8504800) 00010000:00010000:3.0:1789683495.954199:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683495.954202:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176800, rc 0) 00000100:00100000:3.0:1789683495.954269:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+41:11366:x1876618835451648:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 409us (853us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1789683495.954276:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 109 00000100:00100000:2.0:1789683495.958929:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683495.958976:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683495.959134:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835451904 00000100:00100000:3.0:1789683495.959143:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835451904 00000100:00100000:3.0:1789683495.959212:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 110 00000100:00100000:3.0:1789683495.959231:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+41:11366:x1876618835451904:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789683495.959258:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683495.959282:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889e01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc671 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.959430:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889e08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.959445:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889e08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.959472:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889e08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683495.959484:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789683495.959604:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889e01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc671 expref: 44 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.959622:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889e08 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc671 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.959631:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0fb8504800) 00010000:00010000:3.0:1789683495.959634:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789683495.959638:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176200, rc 0) 00000100:00100000:3.0:1789683495.959962:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+43:11366:x1876618835451904:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 731us (1039us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1789683495.959970:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 110 00000100:00100000:0.0:1789683495.960295:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835452032 00000100:00100000:0.0:1789683495.960302:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835452032 00000100:00100000:0.0:1789683495.960351:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:0.0:1789683495.960359:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+43:2404:x1876618835452032:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683495.960369:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683495.960386:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b889df3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc66a expref: 43 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683495.960398:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0fb8504800) 00010000:00010000:0.0:1789683495.960402:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683495.960426:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+42:2404:x1876618835452032:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 69us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683495.960432:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00010000:00010000:3.0:1789683495.973388:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683495.973744:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683495.974076:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835452160 00000100:00100000:1.0:1789683495.974089:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835452160 00000100:00100000:1.0:1789683495.974247:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 45 00000100:00100000:1.0:1789683495.974259:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+8:2403:x1876618835452160:12345-192.168.201.50@tcp:1:lfs.0 00010000:00010000:1.0:1789683495.974311:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b889e16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.974335:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b889dd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc65c expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.974344:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789683495.974349:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789683495.974354:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b889e16 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.974392:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b889dd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc65c expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.974407:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b889dd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc65c expref: 8 pid: 8439 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683495.974423:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8437:1876618850210944:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789683495.974529:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865ea3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683495.976773:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8437:1876618850210944:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789683495.976852:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b889e16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683495.978491:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683495.979050:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835452288 00000100:00100000:1.0:1789683495.979061:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835452288 00002000:00100000:1.0:1789683495.979121:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9f0e84414380 x1876618835452288/t0(0) o4->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:551/0 lens 504/0 e 0 to 0 dl 1789683506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789683495.979132:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e84414380 with x1876618835452288 ext(0->8) 00010000:00010000:1.0:1789683495.979141:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b889dd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc65c expref: 9 pid: 8439 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.979157:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b889dd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc65c expref: 9 pid: 8439 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789683495.979165:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f0e84414380 00000100:00100000:1.0:1789683495.979205:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:1.0:1789683495.979224:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec036ece-1720-411a-849c-c978dbb41f8a+9:2402:x1876618835452288:12345-192.168.201.50@tcp:4:lfs.0 00000100:00100000:1.0:1789683495.982031:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec036ece-1720-411a-849c-c978dbb41f8a+11:2402:x1876618835452288:12345-192.168.201.50@tcp:4:lfs.0 Request processed in 2804us (3534us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789683495.982048:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 1 00002000:00100000:1.0:1789683495.982062:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9f0e84414380 x1876618835452288/t4294967303(0) o4->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:551/0 lens 504/448 e 0 to 0 dl 1789683506 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789683495.982074:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e84414380 with x1876618835452288 ext(0->8) 00010000:00010000:1.0:1789683495.982085:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b889dd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc65c expref: 11 pid: 8439 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.982122:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b889dd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc65c expref: 11 pid: 8439 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789683495.982131:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f0e84414380 00000001:00080000:1.0:1789683495.983776:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1789683495.983818:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:3.0:1789683495.986964:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683495.987175:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835452416 00000100:00100000:1.0:1789683495.987187:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835452416 00010000:00010000:1.0:1789683495.987242:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b889dd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc65c expref: 9 pid: 8439 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683495.987293:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 68 00000100:00100000:1.0:1789683495.987303:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb29f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+9:2403:x1876618835452416:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683495.987344:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789683495.987366:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789683495.987369:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789683496 00002000:00010000:1.0:1789683495.987372:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789683496 00002000:00010000:1.0:1789683495.987374:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789683496 00002000:00010000:1.0:1789683495.987377:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789683495.987384:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b889dd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc65c expref: 9 pid: 8439 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.987400:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b889dd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc65c expref: 9 pid: 8439 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.987439:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b889dd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc65c expref: 9 pid: 8439 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.987471:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789683495.987475:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789683495.987481:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b889e16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.987490:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b889e16 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.987761:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683495.987913:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb29f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+8:2403:x1876618835452416:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 610us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683495.987923:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 68 00010000:00010000:3.0:1789683495.988439:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b889e16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.988589:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b889e16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.988616:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b889e16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.988625:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b889e16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.988634:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b889e16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.988641:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837db600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683495.988645:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b889e16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.988654:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b889e16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.988669:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b889e16 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.989982:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b889e16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683495.990356:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+7:2403:x1876618835452160:12345-192.168.201.50@tcp:1:lfs.0 Request processed in 16095us (16614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683495.990366:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 45 00000100:00100000:0.0:1789683495.994004:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683495.994089:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835452672 00000100:00100000:1.0:1789683495.994103:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835452672 00000100:00100000:1.0:1789683495.994196:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 26 00000100:00100000:1.0:1789683495.994207:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f867c8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+42:11366:x1876618835452672:12345-192.168.201.50@tcp:35:lfs.0 00000004:00010000:1.0:1789683495.994281:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889e08 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc671 expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789683495.994481:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1789683495.994656:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1789683495.995060:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1789683495.995099:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889e1d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.995123:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889dc2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc64e expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.995133:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889e1d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.995169:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc64e expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683495.995183:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889dc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc64e expref: 46 pid: 6521 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683495.995198:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1876618850211072:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789683495.995285:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865ea540 going to sleep for 11 seconds 00000100:00100000:0.0:1789683495.999236:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683495.999308:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835452800 00000100:00100000:3.0:1789683495.999320:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835452800 00010000:00010000:3.0:1789683495.999364:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889dc2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc64e expref: 47 pid: 6521 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683495.999407:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:3.0:1789683495.999417:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+47:2402:x1876618835452800:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683495.999435:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683495.999443:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889dc2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc64e expref: 47 pid: 6521 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.999466:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889dc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc64e expref: 47 pid: 6521 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.999488:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0fb8504800) 00010000:00010000:3.0:1789683495.999494:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889e1d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.999512:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889e1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.999521:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889e1d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683495.999541:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683495.999601:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+47:2402:x1876618835452800:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 184us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683495.999626:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 69 00010000:00010000:1.0:1789683496.001267:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889dc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc64e expref: 46 pid: 6521 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683496.001293:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1876618850211072:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789683496.001316:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889e1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.001327:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889e1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.001333:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889e1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789683496.001571:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1789683496.001934:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1789683496.002047:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876618850211200:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789683496.002115:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683496.002150:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1789683496.002236:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850211200 00000100:00100000:0.0:1789683496.002243:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850211200 00000100:00100000:0.0:1789683496.002327:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789683496.002338:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1876618850211200:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789683496.002431:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1876618850211200:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 95us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683496.002444:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1789683496.002698:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683496.002727:0:6524:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:1.0:1789683496.002733:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:1.0:1789683496.002752:0:6524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0fb7a10700, transno 4294967302 00000100:00100000:1.0:1789683496.002774:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876618850211200:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789683496.002908:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1789683496.002952:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876618850211328:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789683496.002980:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683496.003008:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f865eaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683496.003144:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850211328 00000100:00100000:3.0:1789683496.003150:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850211328 00000100:00100000:3.0:1789683496.003188:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789683496.003197:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1876618850211328:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789683496.003324:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6524:x1876618850211328:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 128us (342us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789683496.003330:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789683496.003661:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876618850211328:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789683496.003765:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1789683496.003876:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889e1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.003887:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889e1d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.003895:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889e1d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.003902:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dbc00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683496.003907:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889e1d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.003916:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889e1d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.003945:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0fb8504800) 00010000:00010000:1.0:1789683496.003948:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789683496.003954:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889e1d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.003961:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889e1d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789683496.004056:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789683496.004108:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1789683496.004119:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410053334378ns, next at 411053332115ns, rc = 0 00000001:00080000:1.0:1789683496.004125:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1789683496.004150:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0fb8504800) 00010000:00010000:1.0:1789683496.004153:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789683496.004161:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b889e08 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc671 expref: 50 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683496.004311:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f867c8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+49:11366:x1876618835452672:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 10105us (10316us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789683496.004319:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 26 00000020:00080000:1.0:1789683496.004323:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789683496.007225:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683496.007325:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835452928 00000100:00100000:3.0:1789683496.007335:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835452928 00000100:00100000:3.0:1789683496.007427:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 111 00000100:00100000:3.0:1789683496.007439:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+49:11366:x1876618835452928:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789683496.007464:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683496.007490:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889e24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc678 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.007559:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889e24 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc678 expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.007574:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889e24 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc678 expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.007592:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:3.0:1789683496.007596:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789683496.007599:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6177600, rc 0) 00000100:00100000:3.0:1789683496.007719:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+50:11366:x1876618835452928:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 282us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683496.007741:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 111 00000100:00100000:0.0:1789683496.011029:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683496.011110:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835453184 00000100:00100000:3.0:1789683496.011121:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835453184 00000100:00100000:3.0:1789683496.011177:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:3.0:1789683496.011188:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+50:11366:x1876618835453184:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789683496.011623:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+51:11366:x1876618835453184:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 436us (601us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789683496.011632:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:2.0:1789683496.096396:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683496.096490:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835453312 00000100:00100000:3.0:1789683496.096510:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835453312 00000100:00100000:3.0:1789683496.096572:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 112 00000100:00100000:3.0:1789683496.096584:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+51:11376:x1876618835453312:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:3.0:1789683496.096662:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e2b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.096691:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.096704:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.096717:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889e32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.096724:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889e32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.096730:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889e32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.096863:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.096873:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.096880:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683496.096930:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.096944:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.096951:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e2b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.096957:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.096963:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683496.096967:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.096975:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e2b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.096986:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:3.0:1789683496.096989:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683496.096994:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.097007:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.097024:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889e32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.097030:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889e32 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.097035:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889e32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.097040:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683496.097043:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889e32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.097048:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889e32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.097054:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0e826a2000) 00010000:00010000:3.0:1789683496.097057:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683496.097059:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889e32 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.097064:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889e32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.097072:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.097077:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.097088:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.097093:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683496.097095:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.097100:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.097107:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:3.0:1789683496.097109:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683496.097111:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.097116:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683496.097191:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+51:11376:x1876618835453312:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 608us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683496.097197:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 112 00000100:00100000:0.0:1789683496.132716:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683496.132868:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835453568 00000100:00100000:1.0:1789683496.132879:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835453568 00000100:00100000:1.0:1789683496.132942:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 113 00000100:00100000:1.0:1789683496.132953:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+51:11379:x1876618835453568:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789683496.132978:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683496.133000:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889e40 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc67f expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133093:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889e47 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133111:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889e47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133123:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889e47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133135:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889e4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133143:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889e4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133149:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889e4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133281:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889e55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133290:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889e55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133298:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889e55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683496.133311:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789683496.133394:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889e47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133411:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889e47 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133418:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889e47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133424:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837da200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683496.133429:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889e47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133436:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889e47 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133460:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:1.0:1789683496.133464:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683496.133469:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889e47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133474:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b889e47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133489:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889e4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133494:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889e4e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133509:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889e4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133514:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837db600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683496.133522:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889e4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133529:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889e4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133536:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0e826a2000) 00010000:00010000:1.0:1789683496.133539:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683496.133542:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889e4e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133548:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b889e4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133583:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b889e40 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc67f expref: 54 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133597:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889e55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc67f expref: 53 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683496.133604:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:1.0:1789683496.133606:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683496.133609:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dac00, rc 0) 00000100:00100000:1.0:1789683496.133687:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+53:11379:x1876618835453568:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 735us (980us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789683496.133695:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 113 00000100:00100000:0.0:1789683496.139347:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683496.140319:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835453696 00000100:00100000:3.0:1789683496.140332:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835453696 00000100:00100000:3.0:1789683496.140403:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 114 00000100:00100000:3.0:1789683496.140413:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+53:11379:x1876618835453696:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:2.0:1789683496.141412:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.141434:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.141463:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.141516:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.141538:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.141545:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.141552:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683496.141557:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.141565:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.141578:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:2.0:1789683496.141581:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789683496.141586:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e63 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.141591:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b889e63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683496.141865:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+53:11379:x1876618835453696:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 1450us (2525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683496.141874:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 114 00000100:00100000:2.0:1789683496.145378:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683496.145594:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835453952 00000100:00100000:1.0:1789683496.145603:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835453952 00000100:00100000:1.0:1789683496.145698:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:1.0:1789683496.145709:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+53:11379:x1876618835453952:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:1.0:1789683496.145966:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+54:11379:x1876618835453952:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 259us (598us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1789683496.145974:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:0.0:1789683496.228808:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683496.229018:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835454208 00000100:00100000:2.0:1789683496.229030:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835454208 00000100:00100000:2.0:1789683496.229106:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 115 00000100:00100000:2.0:1789683496.229128:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+54:11388:x1876618835454208:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683496.229172:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683496.229175:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789683496.229204:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b889de5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc663 expref: 54 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.229237:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:2.0:1789683496.229242:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683496.229257:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889e6a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc686 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.229370:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889e71 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.229385:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889e55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc67f expref: 54 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.229406:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889e71 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.229473:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889e55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc67f expref: 54 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.229486:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889e55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc67f expref: 54 pid: 12533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683496.229500:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8448b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876618850211456:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683496.229597:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f845d3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683496.234523:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683496.234626:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8448b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876618850211456:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683496.234664:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889e71 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683496.235080:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835454336 00000100:00100000:3.0:1789683496.235089:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835454336 00010000:00010000:3.0:1789683496.235125:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889e55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc67f expref: 55 pid: 12533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683496.235188:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 70 00000100:00100000:3.0:1789683496.235198:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+55:2402:x1876618835454336:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683496.235224:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683496.235233:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889e55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc67f expref: 55 pid: 12533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.235469:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889e55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc67f expref: 55 pid: 12533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.235495:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b889e55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc67f expref: 55 pid: 12533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.235513:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:3.0:1789683496.235519:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889e71 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.235529:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889e71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.235537:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889e71 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.235567:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683496.235630:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+54:2402:x1876618835454336:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 433us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683496.235638:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 70 00010000:00010000:2.0:1789683496.235730:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889e71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.235738:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889e71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683496.235761:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789683496.235947:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889e6a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc686 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.235963:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889e71 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc686 expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.235971:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:2.0:1789683496.235974:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789683496.235976:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30400, rc 0) 00000100:00100000:2.0:1789683496.236003:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+54:11388:x1876618835454208:12345-192.168.201.50@tcp:101:bash.0 Request processed in 6889us (7229us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789683496.236010:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 115 00000100:00100000:0.0:1789683496.246764:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683496.246920:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835454464 00000100:00100000:3.0:1789683496.246944:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835454464 00000100:00100000:3.0:1789683496.247000:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 116 00000100:00100000:3.0:1789683496.247009:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+54:11388:x1876618835454464:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789683496.247033:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683496.247054:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889e7f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc68d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.247087:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.247102:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.247115:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.247501:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889e7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc68d expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.247521:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc68d expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.247530:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:3.0:1789683496.247533:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789683496.247599:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176400, rc 0) 00000100:00100000:3.0:1789683496.247733:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+55:11388:x1876618835454464:12345-192.168.201.50@tcp:101:bash.0 Request processed in 725us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683496.247740:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 116 00000100:00100000:0.0:1789683496.259600:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683496.259726:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835454720 00000100:00100000:2.0:1789683496.259742:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835454720 00000100:00100000:2.0:1789683496.259858:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 117 00000100:00100000:2.0:1789683496.259868:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+55:11388:x1876618835454720:12345-192.168.201.50@tcp:36:bash.0 00010000:00010000:2.0:1789683496.260129:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889e8d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.260165:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889e8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.260177:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889e8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789683496.260237:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1789683496.260263:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068e7cb9a reply state 00000000fdeba29e transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889e8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.260276:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889e8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.260284:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:2.0:1789683496.260288:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789683496.260292:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683496.260387:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+58:11388:x1876618835454720:12345-192.168.201.50@tcp:36:bash.0 Request processed in 519us (796us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789683496.260396:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 117 00000020:00080000:2.0:1789683496.260401:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789683496.264416:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683496.264561:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835454848 00000100:00100000:2.0:1789683496.264571:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835454848 00000100:00100000:2.0:1789683496.264631:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 118 00000100:00100000:2.0:1789683496.264641:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+58:11388:x1876618835454848:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683496.264685:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683496.264708:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b889e94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc694 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.264850:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889e9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.265076:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889e71 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc686 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.265085:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889e9b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.265133:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889e71 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc686 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.265146:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889e71 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc686 expref: 59 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683496.265160:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8448b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876618850211584:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683496.265253:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f845d3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683496.270474:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8448b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876618850211584:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683496.270521:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889e9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683496.280238:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683496.282366:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835454976 00000100:00100000:0.0:1789683496.282389:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835454976 00010000:00010000:0.0:1789683496.282450:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889e71 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc686 expref: 60 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683496.282506:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 71 00000100:00100000:0.0:1789683496.282516:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+60:2403:x1876618835454976:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683496.282533:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683496.282539:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889e71 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc686 expref: 60 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.282554:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889e71 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc686 expref: 60 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.282579:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b889e71 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc686 expref: 60 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.282601:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:0.0:1789683496.282625:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889e9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.282634:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889e9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.282641:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889e9b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.282684:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683496.283079:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+59:2403:x1876618835454976:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 563us (2866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683496.283088:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 71 00010000:00010000:2.0:1789683496.283324:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889e9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.283335:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889e9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683496.283411:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789683496.283416:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683496.283442:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889e9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.283509:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b889e94 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc694 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.283527:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889e9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc694 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.283536:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:2.0:1789683496.283539:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683496.283542:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30800, rc 0) 00000100:00100000:2.0:1789683496.283581:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+58:11388:x1876618835454848:12345-192.168.201.50@tcp:101:bash.0 Request processed in 18942us (19175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683496.283588:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 118 00000100:00100000:0.0:1789683496.299056:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683496.299277:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835455232 00000100:00100000:3.0:1789683496.299304:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835455232 00000100:00100000:3.0:1789683496.299413:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:3.0:1789683496.299425:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+58:11388:x1876618835455232:12345-192.168.201.50@tcp:35:bash.0 00000100:00100000:3.0:1789683496.299682:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+59:11388:x1876618835455232:12345-192.168.201.50@tcp:35:bash.0 Request processed in 251us (629us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1789683496.299690:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:1.0:1789683496.385661:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683496.387648:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835455360 00000100:00100000:0.0:1789683496.387663:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835455360 00000100:00100000:0.0:1789683496.387992:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 119 00000100:00100000:0.0:1789683496.388005:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+59:11395:x1876618835455360:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789683496.388033:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683496.388055:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889ea2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc69b expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.388121:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889ea9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.388136:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.388148:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683496.388220:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789683496.388225:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683496.388245:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.388271:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889ea2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc69b expref: 61 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.388291:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc69b expref: 60 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.388300:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:0.0:1789683496.388303:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683496.388308:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454de00, rc 0) 00000100:00100000:0.0:1789683496.388385:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+60:11395:x1876618835455360:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 383us (2732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683496.388392:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 119 00000100:00100000:1.0:1789683496.392696:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683496.392835:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835455488 00000100:00100000:3.0:1789683496.392846:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835455488 00000100:00100000:3.0:1789683496.392903:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 120 00000100:00100000:3.0:1789683496.392914:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+60:11395:x1876618835455488:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789683496.392937:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683496.392958:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889eb0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc6a2 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393023:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889eb7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393039:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889eb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393051:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889eb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393062:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889ebe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393069:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889ebe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393075:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889ebe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393165:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b889ec5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393175:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b889ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393182:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b889ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683496.393236:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789683496.393241:0:12533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789683496.393261:0:12533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b889ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393273:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b889ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393282:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889eb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393288:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889eb7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393294:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889eb7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393299:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683496.393303:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889eb7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393311:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889eb7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393331:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:3.0:1789683496.393334:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683496.393339:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889eb7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393345:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889eb7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393358:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889ebe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393364:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889ebe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393369:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889ebe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393374:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683496.393377:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889ebe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393383:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889ebe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.393390:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0e826a2000) 00010000:00010000:3.0:1789683496.393393:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683496.394858:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889ebe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.394870:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889ebe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.394929:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889eb0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a2 expref: 62 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.394944:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b889ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a2 expref: 61 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.394953:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:3.0:1789683496.394955:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683496.394958:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6177c00, rc 0) 00000100:00100000:3.0:1789683496.395041:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+61:11395:x1876618835455488:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 2128us (2354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683496.395050:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 120 00000100:00100000:1.0:1789683496.400104:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683496.400273:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683496.400584:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835455872 00000100:00100000:2.0:1789683496.400595:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835455872 00000100:00100000:2.0:1789683496.400659:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 121 00000100:00100000:2.0:1789683496.400679:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+61:11395:x1876618835455872:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683496.400701:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683496.400722:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889ecc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc6a9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.400865:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.400880:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889e9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc694 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.400889:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b889ec5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a2 expref: 62 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.400913:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.400947:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b889ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a2 expref: 62 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.400961:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b889ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a2 expref: 62 pid: 12533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683496.400975:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8448b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876618850211712:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683496.401068:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889e9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc694 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.401078:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889e9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc694 expref: 62 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683496.401086:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8448b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876618850211840:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683496.401108:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f845d3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683496.402004:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835455616 00000100:00100000:3.0:1789683496.402013:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835455616 00010000:00010000:3.0:1789683496.402042:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b889ec5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a2 expref: 63 pid: 12533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683496.402117:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:3.0:1789683496.402126:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+63:2403:x1876618835455616:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683496.402138:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683496.402144:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b889ec5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a2 expref: 63 pid: 12533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.402157:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b889ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a2 expref: 63 pid: 12533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.402191:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:3.0:1789683496.402196:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.402204:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.402221:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683496.402265:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+63:2403:x1876618835455616:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 140us (2169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683496.402274:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 72 00010000:00010000:2.0:1789683496.414040:0:6523:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.50@tcp) returned -22 from blocking AST (req@000000006aff9ffa x1876618850211712) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b889ec5 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a2 expref: 62 pid: 12533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.414072:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b889ec5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a2 expref: 62 pid: 12533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683496.414093:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8448b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876618850211712:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683496.414131:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8448b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876618850211840:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683496.414153:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:2.0:1789683496.414159:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.414169:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.414179:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683496.421840:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683496.421938:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835456000 00000100:00100000:0.0:1789683496.421949:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835456000 00010000:00010000:0.0:1789683496.421989:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889e9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc694 expref: 62 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683496.422032:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 73 00000100:00100000:0.0:1789683496.422042:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+62:2402:x1876618835456000:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683496.422057:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683496.422064:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889e9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc694 expref: 62 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.422099:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889e9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc694 expref: 62 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.422120:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b889e9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc694 expref: 62 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.422136:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:0.0:1789683496.422140:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.422150:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.422158:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.422191:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683496.422259:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+61:2402:x1876618835456000:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 218us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683496.422268:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 73 00010000:00010000:2.0:1789683496.422533:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.422543:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683496.422561:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789683496.422695:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889ecc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a9 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.422711:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a9 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.422720:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:2.0:1789683496.422723:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789683496.422725:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31c00, rc 0) 00000100:00100000:2.0:1789683496.422764:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+61:11395:x1876618835455872:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 22097us (22492us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789683496.422828:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 121 00000100:00100000:1.0:1789683496.426008:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683496.426160:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835456256 00000100:00100000:2.0:1789683496.426171:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835456256 00000100:00100000:2.0:1789683496.426246:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:2.0:1789683496.426258:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+61:11395:x1876618835456256:12345-192.168.201.50@tcp:103:lfs.0 00010000:00010000:2.0:1789683496.426274:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683496.426300:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889e24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc678 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683496.426321:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:2.0:1789683496.426326:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683496.426371:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+60:11395:x1876618835456256:12345-192.168.201.50@tcp:103:lfs.0 Request processed in 115us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683496.426379:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:1.0:1789683496.432200:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683496.432343:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835456384 00000100:00100000:3.0:1789683496.432357:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835456384 00000100:00100000:3.0:1789683496.432432:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 122 00000100:00100000:3.0:1789683496.432444:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+60:11395:x1876618835456384:12345-192.168.201.50@tcp:58:lfs.0 00010000:00010000:3.0:1789683496.432565:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889ee1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.432701:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889ee1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683496.432715:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889ee1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789683496.432990:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789683496.433129:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+60:11395:x1876618835456384:12345-192.168.201.50@tcp:58:lfs.0 Request processed in 685us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683496.433137:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 122 00000100:00100000:1.0:1789683496.443040:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683496.443124:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835456512 00000100:00100000:0.0:1789683496.443134:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835456512 00000100:00100000:0.0:1789683496.443192:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 123 00000100:00100000:0.0:1789683496.443203:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+60:11395:x1876618835456512:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789683496.443235:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683496.443257:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889ee8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc6b0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.443334:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889ee1 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.443346:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889ee8 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6b0 expref: 61 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.443365:0:8462:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889ee1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.443378:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889ee8 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6b0 expref: 61 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.443391:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:0.0:1789683496.443394:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789683496.443397:0:8462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889ee8 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6b0 expref: 61 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683496.443405:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454ca00, rc 0) 00000100:00100000:0.0:1789683496.443472:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+61:11395:x1876618835456512:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 271us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683496.443479:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 123 00000100:00100000:1.0:1789683496.475420:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683496.475466:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683496.475509:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683496.475543:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683496.475685:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835457152 00000100:00100000:0.0:1789683496.475696:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835457152 00000100:00080000:0.0:1789683496.475724:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789683496.475727:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835456896 00000100:00100000:2.0:1789683496.475731:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835456896 00000100:00100000:0.0:1789683496.475769:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835456768 00000100:00100000:0.0:1789683496.475773:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835456768 00000100:00080000:0.0:1789683496.475812:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789683496.475827:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 294 00000100:00100000:0.0:1789683496.475852:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835457152:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683496.475929:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835457152:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 79us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683496.475937:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 294 00000100:00100000:0.0:1789683496.475979:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 295 00000100:00100000:0.0:1789683496.475986:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835456768:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683496.476013:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835456768:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 28us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683496.476020:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 295 00000100:00100000:2.0:1789683496.476023:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 114 00000100:00100000:2.0:1789683496.476030:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83772a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2405:x1876618835456896:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683496.476058:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83772a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2405:x1876618835456896:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 29us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683496.476064:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 114 00000100:00100000:3.0:1789683496.476086:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835456640 00000100:00100000:3.0:1789683496.476090:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835456640 00000100:00100000:1.0:1789683496.476183:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683496.476202:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 387 00000100:00100000:2.0:1789683496.476221:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:2405:x1876618835456640:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683496.476273:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835457024 00000100:00100000:3.0:1789683496.476277:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835457024 00000100:00100000:3.0:1789683496.476312:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 296 00000100:00100000:3.0:1789683496.476319:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835457024:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683496.476369:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:2405:x1876618835456640:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 160us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683496.476382:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 387 00000100:00080000:0.0:1789683496.478399:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683496.489323:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835457024:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 12989us (13124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683496.489339:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 296 00000100:00100000:0.0:1789683496.543140:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850211968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683496.543229:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683496.543508:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850211968 00000100:00100000:3.0:1789683496.543517:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850211968 00000100:00100000:3.0:1789683496.543574:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789683496.543585:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850211968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789683496.543622:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789683496.543866:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850211968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 282us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683496.543875:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789683496.546092:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850211968:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789683496.992604:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683497.055033:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683497.055060:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850212096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683497.055139:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683497.056401:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850212096 00000100:00100000:2.0:1789683497.056413:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850212096 00000100:00100000:2.0:1789683497.056577:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789683497.056589:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850212096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789683497.056628:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789683497.056776:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850212096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 188us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683497.056802:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789683497.056931:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850212096:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789683497.057075:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1789683497.311079:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789683497.311090:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789683497.311135:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1789683497.311159:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789683497.311324:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8448b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1876618850212224:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789683497.311457:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea0300 going to sleep for 11 seconds 00000100:00100000:2.0:1789683497.322518:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8448b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1876618850212224:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789683497.323079:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683497.323185:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835457280 00000100:00100000:0.0:1789683497.323205:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835457280 00000100:00100000:0.0:1789683497.323282:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 124 00000100:00100000:0.0:1789683497.323293:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+61:11396:x1876618835457280:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789683497.323324:0:6523:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789683497.323444:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+61:11396:x1876618835457280:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 151us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683497.323452:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 124 00000100:00080000:2.0:1789683497.323869:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683497.332672:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683497.333089:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835457408 00000100:00100000:3.0:1789683497.333100:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835457408 00000100:00100000:3.0:1789683497.333167:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 125 00000100:00100000:3.0:1789683497.333178:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+61:11396:x1876618835457408:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789683497.333270:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889eef lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333288:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889eef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333299:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889eef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333328:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889ef6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333336:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333343:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333367:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889efd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333375:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889efd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333381:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889efd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683497.333444:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789683497.333449:0:12533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789683497.333462:0:12533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889efd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333474:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889eef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333480:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889eef lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333487:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889eef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333502:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683497.333506:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889eef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333513:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889eef lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333526:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0f854c2c00) 00010000:00010000:3.0:1789683497.333529:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683497.333534:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889eef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333540:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889eef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333552:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333559:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889ef6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333564:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333570:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683497.333583:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333589:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889ef6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333608:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9f0e826a2200) 00010000:00010000:3.0:1789683497.333610:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683497.333613:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889ef6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333620:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889ef6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333634:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889efd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333639:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889efd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333644:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889efd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333649:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683497.333661:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889efd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333667:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889efd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.333674:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:3.0:1789683497.334587:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683497.334594:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889efd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.334602:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889efd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683497.334738:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+61:11396:x1876618835457408:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 Request processed in 1557us (2083us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683497.334748:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 125 00000100:00100000:3.0:1789683497.344019:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683497.345627:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835457664 00000100:00100000:2.0:1789683497.345643:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835457664 00000100:00100000:2.0:1789683497.345727:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 126 00000100:00100000:2.0:1789683497.345739:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+61:11396:x1876618835457664:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683497.345764:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683497.345837:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889f04 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc6b7 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.345958:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b889f0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.345974:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b889f0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.345988:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b889f0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683497.346003:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789683497.346084:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b889f0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.346091:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b889f0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.346098:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b889f0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.346104:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683497.346108:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b889f0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.346116:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b889f0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.346127:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:2.0:1789683497.346131:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789683497.346136:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b889f0b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.346152:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b889f0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.346205:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889f04 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6b7 expref: 63 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.346216:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0f854c2c00) 00010000:00010000:2.0:1789683497.346218:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789683497.346222:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889f04 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6b7 expref: 63 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.346232:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30600, rc 0) 00000100:00100000:2.0:1789683497.346307:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+62:11396:x1876618835457664:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 570us (2299us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1789683497.346314:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 126 00000100:00100000:1.0:1789683497.352709:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683497.352763:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835457792 00000100:00100000:2.0:1789683497.352775:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835457792 00000100:00100000:2.0:1789683497.352855:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 127 00000100:00100000:2.0:1789683497.352866:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+62:11396:x1876618835457792:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789683497.352904:0:6522:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789683497.353018:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+62:11396:x1876618835457792:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 153us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683497.353026:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 127 00000100:00100000:1.0:1789683497.358489:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683497.358720:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835458048 00000100:00100000:3.0:1789683497.358731:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835458048 00000100:00100000:3.0:1789683497.358900:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 128 00000100:00100000:3.0:1789683497.358913:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+62:11396:x1876618835458048:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683497.358944:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683497.358948:0:12533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789683497.358981:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889ea9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc69b expref: 62 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.359002:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:3.0:1789683497.359008:0:12533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683497.359024:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889f19 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc6be expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789683497.359418:0:12533:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789683497.359587:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889f20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.359601:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889f20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.359612:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889f20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.359684:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889f19 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6be expref: 64 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.359698:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889f20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6be expref: 63 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.359705:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0e826a2200) 00010000:00010000:3.0:1789683497.359708:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683497.359710:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176e00, rc 0) 00000100:00100000:3.0:1789683497.359780:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+63:11396:x1876618835458048:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 869us (1311us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789683497.359816:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 128 00000100:00100000:1.0:1789683497.390905:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683497.391665:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835458304 00000100:00100000:0.0:1789683497.391676:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835458304 00000100:00100000:0.0:1789683497.391736:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 129 00000100:00100000:0.0:1789683497.391760:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+63:11396:x1876618835458304:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789683497.391847:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683497.391875:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889f20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6be expref: 63 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.391898:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0e826a2200) 00010000:00010000:0.0:1789683497.391910:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789683497.392018:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889f2e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392035:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889f2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392046:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889f2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392098:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b889f35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x34db130d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392106:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b889f35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x34db130d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392113:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b889f35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x34db130d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392315:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889f2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392324:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889f2e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392342:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889f2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392348:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454ce00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683497.392352:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889f2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392360:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889f2e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392369:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:0.0:1789683497.392372:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683497.392376:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889f2e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392381:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b889f2e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392392:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b889f35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x34db130d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392398:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b889f35 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x34db130d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392404:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b889f35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x34db130d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392410:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683497.392413:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b889f35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x34db130d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392429:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b889f35 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x34db130d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392438:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x34db130d (ffff9f0e835a6b00) 00010000:00010000:0.0:1789683497.392441:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683497.392444:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b889f35 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x34db130d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.392449:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b889f35 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x34db130d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683497.392742:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+62:11396:x1876618835458304:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 982us (1846us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789683497.392749:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 129 00000100:00100000:1.0:1789683497.401092:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683497.401310:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835458432 00000100:00100000:0.0:1789683497.401321:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835458432 00000100:00100000:0.0:1789683497.401410:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 130 00000100:00100000:0.0:1789683497.401422:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+62:11396:x1876618835458432:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683497.401451:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683497.401488:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889f3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc6c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.401532:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.401548:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.401561:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.401693:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889f3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6c5 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.401712:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6c5 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.401720:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0e835a6400) 00010000:00010000:0.0:1789683497.401723:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789683497.401727:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d000, rc 0) 00000100:00100000:0.0:1789683497.401813:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+63:11396:x1876618835458432:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 394us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683497.401821:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 130 00000100:00100000:1.0:1789683497.414027:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683497.414114:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835458688 00000100:00100000:3.0:1789683497.414125:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835458688 00000100:00100000:3.0:1789683497.414206:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 131 00000100:00100000:3.0:1789683497.414217:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+63:11396:x1876618835458688:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789683497.414302:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889f4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.414322:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889f4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.414335:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889f4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789683497.414533:0:12533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1789683497.414545:0:12533:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411463759710ns, next at 412463756660ns, rc = 0 00000004:00010000:3.0:1789683497.414613:0:12533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000134226f7 reply state 000000004ab69396 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889f4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.414627:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889f4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.414635:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0e835a6400) 00010000:00010000:3.0:1789683497.414637:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789683497.414642:0:12533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789683497.414763:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+65:11396:x1876618835458688:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 547us (744us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789683497.414771:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 131 00000100:00100000:1.0:1789683497.421918:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683497.422018:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835458816 00000100:00100000:0.0:1789683497.422029:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835458816 00000100:00100000:0.0:1789683497.422099:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 132 00000100:00100000:0.0:1789683497.422112:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+65:11396:x1876618835458816:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683497.422137:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683497.422157:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889f51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc6cc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.422226:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889f51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6cc expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.422241:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889f51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6cc expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.422283:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0e835a6400) 00010000:00010000:0.0:1789683497.422287:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789683497.422291:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454de00, rc 0) 00000100:00100000:0.0:1789683497.422355:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+66:11396:x1876618835458816:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 245us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683497.422361:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 132 00000100:00100000:1.0:1789683497.437181:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683497.437349:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835458944 00000100:00100000:2.0:1789683497.437359:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835458944 00000100:00100000:2.0:1789683497.437442:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 46 00000100:00100000:2.0:1789683497.437466:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:2403:x1876618835458944:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789683497.437710:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:2403:x1876618835458944:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 245us (537us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789683497.437718:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 46 00000100:00080000:0.0:1789683497.439051:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683497.441063:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683497.446581:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835459200 00000100:00100000:2.0:1789683497.446599:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835459200 00000100:00100000:2.0:1789683497.446696:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:2.0:1789683497.446707:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+66:11396:x1876618835459200:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789683497.447017:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+67:11396:x1876618835459200:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 311us (5961us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1789683497.447025:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:1.0:1789683497.449868:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683497.451434:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835459456 00000100:00100000:2.0:1789683497.451452:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835459456 00000100:00100000:2.0:1789683497.451548:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 133 00000100:00100000:2.0:1789683497.451559:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+67:11396:x1876618835459456:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789683497.451700:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+67:11396:x1876618835459456:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 142us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683497.451707:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 133 00000100:00100000:1.0:1789683497.457506:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683497.457758:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835459584 00000100:00100000:3.0:1789683497.457769:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835459584 00000100:00100000:3.0:1789683497.457858:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 134 00000100:00100000:3.0:1789683497.457868:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+67:11396:x1876618835459584:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683497.457889:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683497.457908:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889f58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc6d3 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.457975:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889f5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.457989:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889f5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.458001:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889f5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683497.458047:0:12533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789683497.458082:0:12533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889f5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.458107:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889f58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6d3 expref: 69 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.458125:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889f5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6d3 expref: 68 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.458133:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0e835a6400) 00010000:00010000:3.0:1789683497.458136:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789683497.458140:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176e00, rc 0) 00000100:00100000:3.0:1789683497.458388:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+68:11396:x1876618835459584:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 520us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683497.458395:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 134 00000100:00100000:0.0:1789683497.473210:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683497.473293:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835459712 00000100:00100000:2.0:1789683497.473305:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835459712 00000100:00100000:2.0:1789683497.473373:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:2.0:1789683497.473384:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+7:2403:x1876618835459712:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683497.473407:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683497.473434:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b889f66 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc6da expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789683497.473496:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac6729, blocks: 0x0 00010000:00010000:2.0:1789683497.473520:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=411s v=(0 0) 00010000:00010000:2.0:1789683497.473525:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683497.473534:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b889f66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6da expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.473554:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b889f66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6da expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.473567:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30600, rc 0) 00000100:00100000:2.0:1789683497.473636:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+8:2403:x1876618835459712:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 254us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683497.473643:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:1.0:1789683497.477398:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683497.477519:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835459968 00000100:00100000:2.0:1789683497.477531:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835459968 00000100:00100000:2.0:1789683497.477605:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 135 00000100:00100000:2.0:1789683497.477616:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+68:11396:x1876618835459968:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789683497.477772:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+68:11396:x1876618835459968:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 158us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683497.477780:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 135 00000100:00100000:1.0:1789683497.483950:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683497.484053:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835460096 00000100:00100000:2.0:1789683497.484065:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835460096 00000100:00100000:2.0:1789683497.484133:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:2.0:1789683497.484562:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+8:11396:x1876618835460096:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683497.484598:0:14000:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683497.484618:0:14000:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f07f519d/0xcf8485587b889f6d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc6e1 expref: -99 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.484729:0:14000:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b889f66 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6da expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.484740:0:14000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683497.484744:0:14000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683497.484750:0:14000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f07f519d/0xcf8485587b889f6d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6e1 expref: 9 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.484893:0:14000:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b889f66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6da expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.484908:0:14000:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b889f66 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6da expref: 9 pid: 8437 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683497.484923:0:14000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8448b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14000:1876618850212352:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683497.485100:0:14000:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f90530300 going to sleep for 11 seconds 00000100:00100000:1.0:1789683497.496481:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683497.499175:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835460224 00000100:00100000:3.0:1789683497.499201:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835460224 00010000:00010000:3.0:1789683497.499255:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b889f66 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6da expref: 10 pid: 8437 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683497.499306:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 74 00000100:00100000:3.0:1789683497.499317:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84445c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+10:2403:x1876618835460224:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683497.499335:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683497.499360:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b889f66 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6da expref: 10 pid: 8437 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.499376:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b889f66 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6da expref: 10 pid: 8437 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.499419:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683497.499425:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683497.499434:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f07f519d/0xcf8485587b889f6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6e1 expref: 10 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.499445:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f07f519d/0xcf8485587b889f6d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6e1 expref: 10 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.499521:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f07f519d/0xcf8485587b889f6d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6e1 expref: 10 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683497.499537:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84420700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6508:1876618850212480:192.168.201.50@tcp:105: 00000100:00100000:3.0:1789683497.499625:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88818780 going to sleep for 11 seconds 00000100:00100000:3.0:1789683497.507135:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84420700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6508:1876618850212480:192.168.201.50@tcp:105: 00010000:00010000:3.0:1789683497.507175:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683497.507247:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84445c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+10:2403:x1876618835460224:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 7931us (10797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683497.507259:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 74 00010000:00010000:2.0:1789683497.508164:0:14000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b889f66 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6da expref: 9 pid: 8437 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683497.508195:0:14000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8448b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14000:1876618850212352:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683497.508221:0:14000:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f07f519d/0xcf8485587b889f6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6e1 expref: 8 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.508257:0:14000:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31800, rc 0) 00000100:00100000:2.0:1789683497.508309:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+8:11396:x1876618835460096:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 24167us (24371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683497.508318:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:1.0:1789683497.512249:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683497.512584:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835460352 00000100:00100000:3.0:1789683497.512595:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835460352 00002000:00100000:3.0:1789683497.512647:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9f0e83e03100 x1876618835460352/t0(0) o4->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:553/0 lens 504/0 e 0 to 0 dl 1789683508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789683497.512670:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e83e03100 with x1876618835460352 ext(0->12) 00002000:00010000:3.0:1789683497.512677:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0e83e03100 00000100:00100000:3.0:1789683497.512730:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:3.0:1789683497.512739:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec036ece-1720-411a-849c-c978dbb41f8a+8:2402:x1876618835460352:12345-192.168.201.50@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789683497.514048:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec036ece-1720-411a-849c-c978dbb41f8a+10:2402:x1876618835460352:12345-192.168.201.50@tcp:4:lhsmtool_posix.0 Request processed in 1304us (1803us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789683497.514059:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 3 00002000:00100000:3.0:1789683497.514070:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9f0e83e03100 x1876618835460352/t4294967310(0) o4->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:553/0 lens 504/448 e 0 to 0 dl 1789683508 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789683497.514079:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e83e03100 with x1876618835460352 ext(0->12) 00002000:00010000:3.0:1789683497.514084:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0e83e03100 00000100:00100000:1.0:1789683497.523722:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683497.523961:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835460480 00000100:00100000:2.0:1789683497.523973:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835460480 00000100:00100000:2.0:1789683497.524046:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 136 00000100:00100000:2.0:1789683497.524057:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+68:11396:x1876618835460480:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789683497.526709:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1789683497.526725:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1789683497.526766:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1789683497.526836:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f0f865ea180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789683497.526841:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0f89227300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f0f865ea300 00000020:00080000:3.0:1789683497.526845:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0f89227000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f0fbfbfe800 00000004:00080000:3.0:1789683497.526869:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789683497.526896:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f0fc14f1cc0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789683497.526899:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0e82cbef00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f0e837200c0 00000020:00080000:3.0:1789683497.526902:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0e82cbea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f0fbfbffe00 00010000:00010000:0.0:1789683497.526992:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527004:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c72 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527012:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527019:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683497.527023:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527030:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c72 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527046:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0f83e0bf00) 00010000:00010000:0.0:1789683497.527048:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683497.527054:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c72 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527080:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177a00/0xcf8485587b889c72 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527107:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889d1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527113:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889d1a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527118:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889d1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527124:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454dc00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683497.527127:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889d1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527132:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889d1a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527141:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0f853e3c00) 00010000:00010000:0.0:1789683497.527144:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683497.527147:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889d1a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527153:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889d1a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527168:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527174:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527198:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527205:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683497.527208:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527214:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527223:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0e826a2000) 00010000:00010000:0.0:1789683497.527226:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683497.527229:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d98 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527235:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177800/0xcf8485587b889d98 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527249:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889dbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527256:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889dbb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527261:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889dbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527266:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837da800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683497.527269:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889dbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527285:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889dbb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527294:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0e826a2000) 00010000:00010000:0.0:1789683497.527296:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683497.527299:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889dbb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527305:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b889dbb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527319:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889e8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527324:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889e8d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527329:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889e8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527334:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683497.527336:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889e8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527342:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889e8d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527349:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:0.0:1789683497.527351:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683497.527354:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889e8d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527370:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889e8d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527385:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889f4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527391:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889f4a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527397:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889f4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527403:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683497.527406:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889f4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527412:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889f4a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527419:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0e835a6400) 00010000:00010000:0.0:1789683497.527421:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789683497.527424:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889f4a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.527429:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b889f4a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789683497.527513:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1789683497.527575:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789683497.527807:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+16:11396:x1876618835460480:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 Request processed in 3719us (4064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683497.527819:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 136 00000100:00100000:0.0:1789683497.528839:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8448b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850212608:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789683497.528898:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683497.528936:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683497.528956:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850212736:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789683497.528985:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683497.529019:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850212608 00000100:00100000:0.0:1789683497.529026:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850212608 00000100:00100000:0.0:1789683497.529064:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850212736 00000100:00100000:0.0:1789683497.529067:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850212736 00000100:00100000:0.0:1789683497.529096:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789683497.529104:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1876618850212608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789683497.529132:0:8676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:0.0:1789683497.529163:0:8676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aac6728, atime: 0x6aac6728, ctime: 0x6aac6728, blocks: 0x8 00010000:00010000:0.0:1789683497.529171:0:8676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032dfc6e5/0xcf8485587b889f74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.529198:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1789683497.529203:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683497.529210:0:8676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032dfc6e5/0xcf8485587b889f74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.529227:0:8676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032dfc6e5/0xcf8485587b889f74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.529235:0:8676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032dfc6e5/0xcf8485587b889f74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.529243:0:8676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032dfc6e5/0xcf8485587b889f74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.529261:0:8676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789683497.529415:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1876618850212608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 311us (516us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789683497.529423:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789683497.529438:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789683497.529444:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850212736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789683497.529457:0:8676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00000100:00100000:2.0:1789683497.529806:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683497.529818:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850212864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789683497.529853:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683497.529942:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850212864 00000100:00100000:3.0:1789683497.529948:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850212864 00000100:00100000:3.0:1789683497.529970:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789683497.529977:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8448b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3648:x1876618850212864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789683497.530055:0:14000:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789683497.530066:0:14000:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789683497 00002000:00010000:3.0:1789683497.530068:0:14000:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789683497.530070:0:14000:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789683497 -> 1789683497 00002000:00010000:3.0:1789683497.530072:0:14000:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789683497.530113:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8448b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3648:x1876618850212864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 135us (258us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789683497.530119:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789683497.530269:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1789683497.530276:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0fb7a12300, transno 4294967304 00000004:00080000:2.0:1789683497.530294:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1789683497.530318:0:3648:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9f0e83e00a80 x1876618850212864/t4294967311(4294967311) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789683513 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789683497.530329:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0e83e00a80/2, rc 0, transno 4294967311 00000100:00100000:2.0:1789683497.530334:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850212864:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1789683497.531085:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683497.531095:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032dfc6e5/0xcf8485587b889f74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.531107:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454ce00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683497.531112:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032dfc6e5/0xcf8485587b889f74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.531123:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032dfc6e5/0xcf8485587b889f74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.531142:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032dfc6e5/0xcf8485587b889f74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.531150:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032dfc6e5/0xcf8485587b889f74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.531197:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683497.531199:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683497.531201:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683497.531567:0:8676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edd3aeae/0xcf8485587b889f7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.531589:0:8676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c163d194/0xcf8485587b889d28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc639 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.531599:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789683497.531603:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789683497.531608:0:8676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edd3aeae/0xcf8485587b889f7b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789683497.531755:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789683497.532238:0:8676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c163d194/0xcf8485587b889d28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc639 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.532258:0:8676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c163d194/0xcf8485587b889d28 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc639 expref: 9 pid: 8440 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683497.532276:0:8676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1876618850212992:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789683497.532369:0:8676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa3000 going to sleep for 11 seconds 00000004:00080000:0.0:1789683497.532416:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0e8448b100/2, rc 0, transno 4294967305 00000100:00100000:0.0:1789683497.532433:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8448b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850212608:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789683497.543443:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683497.543566:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683497.543597:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835460736 00000100:00100000:1.0:1789683497.543607:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835460736 00000100:00100000:1.0:1789683497.543664:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:1.0:1789683497.543675:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+10:2403:x1876618835460736:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789683497.546736:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835460608 00000100:00100000:3.0:1789683497.546750:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835460608 00010000:00010000:3.0:1789683497.546831:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c163d194/0xcf8485587b889d28 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc639 expref: 11 pid: 8440 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683497.546884:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 75 00000100:00100000:3.0:1789683497.546895:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+11:2403:x1876618835460608:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683497.546912:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683497.546918:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c163d194/0xcf8485587b889d28 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc639 expref: 11 pid: 8440 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.546933:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c163d194/0xcf8485587b889d28 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc639 expref: 11 pid: 8440 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.546960:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683497.546965:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683497.546971:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000edd3aeae/0xcf8485587b889f7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.547002:0:10343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edd3aeae/0xcf8485587b889f7b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.547027:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683497.547094:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+11:2403:x1876618835460608:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 200us (3660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683497.547102:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 75 00000001:00080000:2.0:1789683497.550519:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1789683497.550549:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:1.0:1789683497.550770:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+7:2403:x1876618835460736:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 Request processed in 7088us (7195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683497.550823:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 52 00010000:00010000:0.0:1789683497.552541:0:8676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c163d194/0xcf8485587b889d28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc639 expref: 6 pid: 8440 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683497.552569:0:8676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1876618850212992:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683497.552599:0:8676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000edd3aeae/0xcf8485587b889f7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.552613:0:8676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000edd3aeae/0xcf8485587b889f7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.552621:0:8676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edd3aeae/0xcf8485587b889f7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.552634:0:8676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edd3aeae/0xcf8485587b889f7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.552641:0:8676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edd3aeae/0xcf8485587b889f7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.552904:0:8676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789683497.553148:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1876618850212736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23702us (24160us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789683497.553159:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789683497.553395:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1789683497.553402:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0e83e00a80, transno 4294967311 00000100:00100000:3.0:1789683497.553423:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9f0e83e03b80 x1876618850212736/t4294967312(4294967312) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789683513 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789683497.553435:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0e83e03b80/2, rc 0, transno 4294967312 00000100:00100000:3.0:1789683497.553440:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850212736:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789683497.554837:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683497.554850:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edd3aeae/0xcf8485587b889f7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.554866:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454c600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683497.554870:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edd3aeae/0xcf8485587b889f7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.554881:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edd3aeae/0xcf8485587b889f7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.554905:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edd3aeae/0xcf8485587b889f7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.554933:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edd3aeae/0xcf8485587b889f7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.554956:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683497.554958:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683497.554960:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683497.562123:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683497.562283:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835460992 00000100:00100000:3.0:1789683497.562293:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835460992 00000100:00100000:3.0:1789683497.562360:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 137 00000100:00100000:3.0:1789683497.562371:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+16:11396:x1876618835460992:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789683497.562428:0:12533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683497.562457:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889f5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6d3 expref: 16 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.562488:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0e835a6400) 00010000:00010000:3.0:1789683497.562495:0:12533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683497.562527:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889f82 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.562556:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889f82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.562567:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889f82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683497.562712:0:12533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007c80d7f reply state 000000006914a8e6 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889f82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.562725:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889f82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.562731:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0e835a6400) 00010000:00010000:3.0:1789683497.562734:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789683497.562737:0:12533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789683497.563137:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+17:11396:x1876618835460992:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 764us (1021us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1789683497.563144:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 137 00000100:00100000:2.0:1789683497.566369:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683497.566443:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835461120 00000100:00100000:3.0:1789683497.566466:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835461120 00000100:00100000:3.0:1789683497.566529:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:3.0:1789683497.566539:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8448ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835461120:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789683497.566712:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789683497.566716:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789683497 -> 1789683496 00002000:00010000:3.0:1789683497.566718:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789683496 00002000:00010000:3.0:1789683497.566721:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789683497 -> 1789683496 00002000:00010000:3.0:1789683497.566723:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789683497.566933:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850213120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683497.566994:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683497.567041:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850213120 00000100:00100000:0.0:1789683497.567046:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850213120 00000100:00100000:0.0:1789683497.567076:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789683497.567083:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1876618850213120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683497.567098:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1789683497.567134:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1876618850213120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683497.567140:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789683497.567203:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850213120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683497.567887:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8448ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+7:2402:x1876618835461120:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 246us (425us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789683497.567907:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:0.0:1789683497.568090:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683497.568104:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850213248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683497.568144:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683497.568242:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850213248 00000100:00100000:1.0:1789683497.568249:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850213248 00000100:00100000:1.0:1789683497.568297:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789683497.568305:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850213248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683497.568337:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789683497.568381:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850213248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683497.568387:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789683497.568489:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850213248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789683497.572648:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683497.572984:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835461376 00000100:00100000:0.0:1789683497.572995:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835461376 00000100:00100000:0.0:1789683497.573058:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 138 00000100:00100000:0.0:1789683497.573070:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8448bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+17:11396:x1876618835461376:12345-192.168.201.50@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789683497.573143:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889f89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.573160:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f43 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6c5 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.573170:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889f89 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.573240:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6c5 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.573255:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6c5 expref: 17 pid: 6521 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683497.573270:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1876618850213376:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789683497.573401:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683497.577552:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683497.577663:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835461504 00000100:00100000:2.0:1789683497.577674:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835461504 00010000:00010000:2.0:1789683497.577717:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f43 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6c5 expref: 18 pid: 6521 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683497.577760:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 76 00000100:00100000:2.0:1789683497.577770:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+18:2402:x1876618835461504:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683497.577816:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683497.577823:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f43 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6c5 expref: 18 pid: 6521 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.577837:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6c5 expref: 18 pid: 6521 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.577857:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0e835a6400) 00010000:00010000:2.0:1789683497.577862:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889f89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.577872:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889f89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.577880:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889f89 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.577901:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683497.577951:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+18:2402:x1876618835461504:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 183us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683497.577976:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 76 00010000:00010000:0.0:1789683497.578773:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6c5 expref: 17 pid: 6521 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683497.578837:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1876618850213376:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683497.578861:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889f89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.578870:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889f89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.578876:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889f89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.578928:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889f89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.578936:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889f89 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.578944:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889f89 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.578962:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454dc00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683497.578966:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889f89 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.578973:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889f89 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.578986:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0e835a6400) 00010000:00010000:0.0:1789683497.578990:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789683497.578994:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889f89 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.579000:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889f89 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683497.579114:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8448bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+16:11396:x1876618835461376:12345-192.168.201.50@tcp:55:lhsmtool_posix.0 Request processed in 6045us (6475us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789683497.579123:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 138 00000100:00100000:1.0:1789683497.582853:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683497.583038:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835461632 00000100:00100000:2.0:1789683497.583050:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835461632 00000100:00100000:2.0:1789683497.583123:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:2.0:1789683497.583135:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:2403:x1876618835461632:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789683497.583199:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000040b43c79/0xcf8485587b889f90 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.583222:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f07f519d/0xcf8485587b889f6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6e1 expref: 7 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.583231:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683497.583236:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789683497.583241:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040b43c79/0xcf8485587b889f90 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.583276:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f07f519d/0xcf8485587b889f6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6e1 expref: 7 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.583290:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f07f519d/0xcf8485587b889f6d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6e1 expref: 7 pid: 14000 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683497.583305:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84488a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1876618850213504:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683497.583398:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f90530300 going to sleep for 11 seconds 00000100:00100000:2.0:1789683497.586485:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683497.586626:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835461760 00000100:00100000:3.0:1789683497.586635:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835461760 00010000:00010000:3.0:1789683497.586684:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f07f519d/0xcf8485587b889f6d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6e1 expref: 8 pid: 14000 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683497.586731:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 77 00000100:00100000:3.0:1789683497.586742:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84489c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+8:2403:x1876618835461760:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683497.586756:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683497.586778:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f07f519d/0xcf8485587b889f6d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6e1 expref: 8 pid: 14000 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.586832:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f07f519d/0xcf8485587b889f6d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6e1 expref: 8 pid: 14000 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.586857:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683497.586861:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683497.586866:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000040b43c79/0xcf8485587b889f90 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.586875:0:10343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040b43c79/0xcf8485587b889f90 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.586894:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683497.586942:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84489c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+8:2403:x1876618835461760:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 202us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683497.586959:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 77 00010000:00010000:1.0:1789683497.587426:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f07f519d/0xcf8485587b889f6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6e1 expref: 7 pid: 14000 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683497.587443:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84488a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1876618850213504:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789683497.587481:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000040b43c79/0xcf8485587b889f90 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.587492:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000040b43c79/0xcf8485587b889f90 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.587507:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040b43c79/0xcf8485587b889f90 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.587528:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000040b43c79/0xcf8485587b889f90 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.587536:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040b43c79/0xcf8485587b889f90 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.587544:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040b43c79/0xcf8485587b889f90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.587551:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683497.587556:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040b43c79/0xcf8485587b889f90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.587563:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040b43c79/0xcf8485587b889f90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.587575:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040b43c79/0xcf8485587b889f90 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.587583:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040b43c79/0xcf8485587b889f90 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683497.587663:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:2403:x1876618835461632:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 Request processed in 4530us (4821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683497.587672:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:2.0:1789683497.591065:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683497.591170:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835462016 00000100:00100000:0.0:1789683497.591180:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835462016 00000100:00100000:0.0:1789683497.591253:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 139 00000100:00100000:0.0:1789683497.591264:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8448b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+16:11396:x1876618835462016:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789683497.591362:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.591379:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e86 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc68d expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.591407:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f97 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.591441:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc68d expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.591455:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc68d expref: 16 pid: 6521 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683497.591480:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876618850213632:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789683497.591557:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683497.594876:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683497.595124:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876618850213632:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683497.595154:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683497.595296:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835462144 00000100:00100000:2.0:1789683497.595304:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835462144 00010000:00010000:2.0:1789683497.595342:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc68d expref: 17 pid: 6521 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683497.595415:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 78 00000100:00100000:2.0:1789683497.595425:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84420700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+17:2402:x1876618835462144:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683497.595439:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683497.595446:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc68d expref: 17 pid: 6521 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.595478:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc68d expref: 17 pid: 6521 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.595501:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b889e86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc68d expref: 17 pid: 6521 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.595516:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:2.0:1789683497.595523:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889ee8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6b0 expref: 16 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.595532:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.595539:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.595546:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f97 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.595635:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683497.595747:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84420700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+16:2402:x1876618835462144:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 322us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683497.595755:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 78 00010000:00010000:0.0:1789683497.599507:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.599527:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.599750:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889f9e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.599768:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889f51 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6cc expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.599778:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889f9e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.599874:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889f51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6cc expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.599890:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889f51 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6cc expref: 16 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683497.599908:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876618850213760:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789683497.600005:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa3000 going to sleep for 11 seconds 00000100:00100000:0.0:1789683497.607965:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683497.608010:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835462272 00000100:00100000:0.0:1789683497.608022:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835462272 00010000:00010000:0.0:1789683497.608073:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889f51 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6cc expref: 17 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683497.608112:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 79 00000100:00100000:0.0:1789683497.608122:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+17:2403:x1876618835462272:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683497.608139:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683497.608147:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889f51 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6cc expref: 17 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.608161:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889f51 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6cc expref: 17 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.608195:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0e835a6400) 00010000:00010000:0.0:1789683497.608200:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889f9e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.608226:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889f9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.608234:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889f9e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.608254:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683497.608313:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+17:2403:x1876618835462272:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 191us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683497.608321:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 79 00010000:00010000:3.0:1789683497.608598:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889f51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6cc expref: 16 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683497.608613:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876618850213760:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789683497.608632:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889f9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.608640:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889f9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.608646:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889f9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789683497.609954:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1789683497.610100:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1789683497.610137:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1789683497.610239:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84422680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1876618850213888:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789683497.610317:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683497.610353:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88818cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683497.610684:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850213888 00000100:00100000:2.0:1789683497.610694:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850213888 00000100:00100000:2.0:1789683497.610736:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789683497.610745:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6522:x1876618850213888:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789683497.610856:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6522:x1876618850213888:12345-0@lo:1000:mdt00_001.0 Request processed in 112us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683497.610863:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789683497.613052:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84422680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1876618850213888:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789683497.613232:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1789683497.613305:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84422680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1876618850214016:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789683497.613386:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683497.613422:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88818300 going to sleep for 11 seconds 00000100:00100000:0.0:1789683497.613503:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850214016 00000100:00100000:0.0:1789683497.613511:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850214016 00000100:00100000:0.0:1789683497.613564:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789683497.613574:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1876618850214016:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789683497.614062:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6522:x1876618850214016:12345-0@lo:1000:mdt00_001.0 Request processed in 488us (675us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789683497.614072:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789683497.614165:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84422680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1876618850214016:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789683497.614225:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889f9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.614237:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889f9e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.614245:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889f9e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.614253:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454da00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683497.614257:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889f9e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.614265:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889f9e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.614282:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0e835a6400) 00010000:00010000:3.0:1789683497.614285:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789683497.614290:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889f9e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.614297:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b889f9e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.614325:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889ee1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.614332:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889ee1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.614337:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889ee1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.614352:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683497.614356:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889ee1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.614362:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889ee1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.614371:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:3.0:1789683497.614374:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789683497.614381:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889ee8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6b0 expref: 19 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.614391:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889ee8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6b0 expref: 19 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.614401:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889ee8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6b0 expref: 19 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.614428:0:6522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889ee8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6b0 expref: 19 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683497.614442:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84422300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876618850214144:192.168.201.50@tcp:105: 00000100:00100000:3.0:1789683497.614542:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85730840 going to sleep for 11 seconds 00000100:00100000:1.0:1789683497.618489:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683497.618700:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84422300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876618850214144:192.168.201.50@tcp:105: 00010000:00010000:3.0:1789683497.618729:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889ee1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.618758:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889ee1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.618827:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fa5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.618843:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fa5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.618854:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fa5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.618865:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fa5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.618870:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fa5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.618876:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fa5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.618881:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683497.618885:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fa5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.618892:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fa5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.618902:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:3.0:1789683497.618905:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683497.618908:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fa5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.618922:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fa5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.618933:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.618938:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f97 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.618944:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.618948:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683497.618950:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.618955:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f97 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.618963:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:3.0:1789683497.618965:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789683497.618968:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f97 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.618974:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b889f97 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683497.619142:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8448b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+19:11396:x1876618835462016:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 27879us (28086us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1789683497.619153:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 139 00000020:00080000:3.0:1789683497.619164:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789683497.620226:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683497.620233:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683497.620764:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789683497.620777:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789683497.621969:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835462400 00000100:00100000:2.0:1789683497.621983:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835462400 00000100:00100000:2.0:1789683497.622090:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:2.0:1789683497.622102:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+19:11395:x1876618835462400:12345-192.168.201.50@tcp:49:lfs.0 00000100:00100000:2.0:1789683497.622271:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+19:11395:x1876618835462400:12345-192.168.201.50@tcp:49:lfs.0 Request processed in 170us (3806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683497.622279:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:1.0:1789683497.629200:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683497.629254:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683497.629340:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835462912 00000100:00100000:0.0:1789683497.629350:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835462912 00000100:00100000:0.0:1789683497.629417:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 140 00000100:00100000:0.0:1789683497.629428:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+19:11395:x1876618835462912:12345-192.168.201.50@tcp:58:lfs.0 00000040:00080000:0.0:1789683497.629626:0:12533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1789683497.629716:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+19:11395:x1876618835462912:12345-192.168.201.50@tcp:58:lfs.0 Request processed in 289us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683497.629723:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 140 00000100:00100000:3.0:1789683497.630903:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835462656 00000100:00100000:3.0:1789683497.630914:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835462656 00000100:00100000:3.0:1789683497.630954:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 32 00000100:00100000:3.0:1789683497.630963:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f867c8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+19:11396:x1876618835462656:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789683497.631217:0:6525:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789683497.631254:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1789683497.631291:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889fac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.631307:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889fac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.631320:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889fac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.631329:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889fac lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.631336:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889fac lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.631342:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889fac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.631373:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789683497.631458:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f867c8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+21:11396:x1876618835462656:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 494us (2280us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789683497.631467:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 32 00010000:00010000:1.0:1789683497.631760:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683497.631767:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889fac lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.631775:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683497.631779:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889fac lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.631809:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889fac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.631822:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0e835a6400) 00010000:00010000:1.0:1789683497.631826:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789683497.631831:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889fac lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.631836:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b889fac lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683497.631867:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683497.631869:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683497.631871:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789683497.635466:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789683497.670465:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683497.670573:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835463040 00000100:00100000:0.0:1789683497.670583:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835463040 00000100:00100000:0.0:1789683497.670671:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 141 00000100:00100000:0.0:1789683497.670682:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+21:11398:x1876618835463040:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789683497.670709:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683497.670730:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889fb3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc6e8 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.670832:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889fba lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.670847:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889fba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.670858:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889fba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.670873:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889fc1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.670881:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.670888:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.670965:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889fc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.670977:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a9 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.670986:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889fc8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.671029:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a9 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683497.671043:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a9 expref: 22 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683497.671059:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1876618850214272:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789683497.671152:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683497.675926:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683497.676046:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1876618850214272:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683497.676077:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889fc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683497.676163:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835463296 00000100:00100000:1.0:1789683497.676172:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835463296 00000100:00100000:1.0:1789683497.676241:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:1.0:1789683497.676252:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+23:6172:x1876618835463296:12345-192.168.201.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789683497.676653:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+24:6172:x1876618835463296:12345-192.168.201.50@tcp:35:ldlm_bl.0 Request processed in 402us (737us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789683497.676661:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:1.0:1789683497.679907:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683497.680070:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835463424 00000100:00100000:3.0:1789683497.680094:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835463424 00010000:00010000:3.0:1789683497.680130:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a9 expref: 24 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683497.680173:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 80 00000100:00100000:3.0:1789683497.680183:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+24:2403:x1876618835463424:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683497.680209:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683497.680215:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a9 expref: 24 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.680228:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a9 expref: 24 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.680247:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b889ed3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6a9 expref: 24 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.680263:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:3.0:1789683497.680268:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889fc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.680277:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.680284:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889fc8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683497.680317:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683497.680377:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+23:2403:x1876618835463424:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 195us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683497.680393:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 80 00010000:00010000:2.0:1789683497.681350:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681362:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683497.681421:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789683497.681426:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683497.681445:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681469:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681486:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889fba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681492:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889fba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681498:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889fba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681504:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683497.681508:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889fba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681516:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889fba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681527:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:2.0:1789683497.681530:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683497.681534:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889fba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681539:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b889fba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681562:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681568:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889fc1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681574:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681579:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683497.681582:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681588:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889fc1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681595:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0e835a6f00) 00010000:00010000:2.0:1789683497.681597:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683497.681600:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889fc1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681605:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b889fc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681640:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b889fb3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6e8 expref: 23 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681665:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6e8 expref: 22 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683497.681684:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:2.0:1789683497.681686:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683497.681689:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454dc00, rc 0) 00000100:00100000:2.0:1789683497.681748:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+22:11398:x1876618835463040:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 11068us (11310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683497.681756:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 141 00010000:00010000:1.0:1789683498.015492:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789683498.546009:0:14318:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789683498.546020:0:14318:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789683498.546052:0:14318:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789683498.546057:0:14318:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789683498.655034:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683498.655045:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683498.655077:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789683498.655086:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789683498.655240:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1876618850214400:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789683498.655335:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683498.663599:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683498.663659:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1876618850214400:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789683498.663669:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835463552 00000100:00100000:3.0:1789683498.663676:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835463552 00000100:00100000:3.0:1789683498.663736:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 142 00000100:00100000:3.0:1789683498.663745:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+22:11410:x1876618835463552:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789683498.663805:0:6522:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789683498.663922:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+22:11410:x1876618835463552:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 176us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683498.663929:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 142 00000100:00100000:1.0:1789683498.666843:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683498.667417:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835463808 00000100:00100000:2.0:1789683498.667430:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835463808 00000100:00100000:2.0:1789683498.667511:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 143 00000100:00100000:2.0:1789683498.667521:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+22:11410:x1876618835463808:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683498.667890:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683498.667913:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889fcf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc6ef expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683498.668031:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889fd6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683498.668048:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683498.668060:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683498.668072:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789683498.668193:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b889fcf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6ef expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683498.668232:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6ef expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683498.668241:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:2.0:1789683498.668244:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683498.668247:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30e00, rc 0) 00000100:00100000:2.0:1789683498.668317:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+24:11410:x1876618835463808:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 797us (1483us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789683498.668325:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 143 00000100:00100000:2.0:1789683498.675061:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683498.675886:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835464064 00000100:00100000:3.0:1789683498.675897:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835464064 00000100:00100000:3.0:1789683498.675959:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 144 00000100:00100000:3.0:1789683498.675970:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+24:11410:x1876618835464064:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789683498.676050:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fe4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683498.676067:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683498.676080:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683498.676245:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683498.676258:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fe4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683498.676265:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fe4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683498.676271:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683498.676275:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fe4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683498.676283:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fe4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683498.676295:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:3.0:1789683498.676298:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789683498.676303:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fe4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683498.676309:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889fe4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683498.676435:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+25:11410:x1876618835464064:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 466us (1379us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789683498.676443:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 144 00000040:00080000:2.0:1789683498.676616:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789683498.676621:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789683498.677112:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789683498.677122:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789683498.685772:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683498.685881:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683498.686215:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835464192 00000100:00100000:3.0:1789683498.686227:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835464192 00000100:00100000:3.0:1789683498.686296:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:3.0:1789683498.686308:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84445450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+25:2402:x1876618835464192:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683498.686327:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683498.686368:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b889fd6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6ef expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683498.686385:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:3.0:1789683498.686390:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683498.686450:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84445450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+24:2402:x1876618835464192:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 145us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683498.686458:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:0.0:1789683498.690770:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835464448 00000100:00100000:0.0:1789683498.690803:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835464448 00000100:00100000:0.0:1789683498.690879:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:0.0:1789683498.690892:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+24:11410:x1876618835464448:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789683498.691415:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+25:11410:x1876618835464448:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 524us (5532us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789683498.691424:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 34 00010000:00010000:1.0:1789683499.039167:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683499.104261:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8448a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850214528:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789683499.104341:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683499.104887:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850214528 00000100:00100000:2.0:1789683499.104897:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850214528 00000100:00100000:2.0:1789683499.104987:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789683499.105000:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850214528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789683499.105042:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683499.105110:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850214528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683499.105118:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789683499.105186:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8448a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850214528:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789683499.105461:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683499.615372:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683499.615397:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850214656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683499.615474:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683499.615552:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850214656 00000100:00100000:1.0:1789683499.615574:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850214656 00000100:00100000:1.0:1789683499.615640:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789683499.617285:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876618850214656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789683499.617315:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683499.617390:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876618850214656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1741us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683499.617399:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789683499.617449:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8448a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850214784:0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.617500:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683499.617529:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850215296:0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.617554:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683499.617571:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850215808:0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.617592:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683499.617629:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850214656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683499.617662:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789683499.617668:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8448a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850215168:0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.617691:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683499.617707:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850215680:0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.617727:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683499.617753:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850215296 00000100:00100000:1.0:1789683499.617758:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850215296 00000100:00100000:1.0:1789683499.617809:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789683499.617828:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850215296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.617866:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850215296:12345-0@lo:400:kworker.0 Request processed in 39us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683499.617890:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789683499.617912:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850215168 00000100:00100000:1.0:1789683499.617916:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850215168 00000100:00100000:1.0:1789683499.617941:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789683499.617948:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850215168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.617979:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850215168:12345-0@lo:400:kworker.0 Request processed in 32us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683499.617985:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789683499.618009:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8448a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850215168:0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.618018:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850215296:0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.618049:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850215808 00000100:00100000:1.0:1789683499.618052:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850215808 00000100:00100000:1.0:1789683499.618079:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850215680 00000100:00100000:1.0:1789683499.618082:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850215680 00000100:00100000:1.0:1789683499.618098:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789683499.618104:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1876618850215808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.618135:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1876618850215808:12345-0@lo:400:kworker.0 Request processed in 31us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683499.618141:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789683499.618163:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789683499.618169:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850215680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.618194:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850215680:12345-0@lo:400:kworker.0 Request processed in 26us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683499.618200:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789683499.618228:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850215680:0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.618247:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850215808:0@lo:400:kworker.0 00000100:00080000:1.0:1789683499.618278:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683499.618282:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683499.618376:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850215040:0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.618404:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683499.618431:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850215552:0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.618449:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683499.618466:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850216064:0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.618484:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683499.618502:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789683499.618508:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8448aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850214912:0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.618528:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683499.618544:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850215424:0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.618563:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683499.618576:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850215936:0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.618594:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683499.618613:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850215552 00000100:00100000:1.0:1789683499.618616:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850215552 00000100:00100000:1.0:1789683499.618636:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850216064 00000100:00100000:1.0:1789683499.618638:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850216064 00000100:00100000:1.0:1789683499.618650:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850214912 00000100:00100000:1.0:1789683499.618652:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850214912 00000100:00100000:1.0:1789683499.618662:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850215424 00000100:00100000:1.0:1789683499.618664:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850215424 00000100:00100000:1.0:1789683499.618676:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850215936 00000100:00100000:1.0:1789683499.618679:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850215936 00000100:00100000:1.0:1789683499.618693:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789683499.618707:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850215552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.618740:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850215552:12345-0@lo:400:kworker.0 Request processed in 34us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683499.618746:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789683499.618761:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789683499.618766:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850216064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.618817:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850216064:12345-0@lo:400:kworker.0 Request processed in 51us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683499.618822:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789683499.618833:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789683499.618838:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850214912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.618858:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850214912:12345-0@lo:400:kworker.0 Request processed in 21us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683499.618863:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789683499.618873:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789683499.618878:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850215424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.618900:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850215424:12345-0@lo:400:kworker.0 Request processed in 23us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683499.618906:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789683499.618917:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789683499.618922:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850215936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.618946:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850215936:12345-0@lo:400:kworker.0 Request processed in 24us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683499.618951:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:1.0:1789683499.618964:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683499.618973:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683499.618993:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8448aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850214912:0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.619002:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850215424:0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.619010:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850215936:0@lo:400:kworker.0 00010000:00080000:1.0:1789683499.619022:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e84489f80 x1876618850215552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683499.619033:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850215552:0@lo:400:kworker.0 00010000:00080000:1.0:1789683499.619042:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e84488a80 x1876618850216064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683499.619049:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850216064:0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.619086:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850215040 00000100:00100000:1.0:1789683499.619090:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850215040 00000100:00100000:1.0:1789683499.619113:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789683499.619119:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850215040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683499.619167:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850215040:12345-0@lo:400:kworker.0 Request processed in 48us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683499.619172:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789683499.619197:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850215040:0@lo:400:kworker.0 00000100:00100000:3.0:1789683499.621854:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850214784 00000100:00100000:3.0:1789683499.621868:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850214784 00000100:00100000:3.0:1789683499.621926:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1789683499.621933:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850214784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683499.622024:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3648:x1876618850214784:12345-0@lo:400:kworker.0 Request processed in 92us (4525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683499.622031:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1789683499.622096:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8448a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3648:1876618850214784:0@lo:400:kworker.0 00010000:00010000:2.0:1789683500.065434:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789683500.586996:0:14370:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789683500.587004:0:14370:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789683500.587030:0:14370:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789683500.587034:0:14370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789683500.818959:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683500.819039:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835464704 00000100:00100000:3.0:1789683500.819050:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835464704 00000100:00100000:3.0:1789683500.819144:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 145 00000100:00100000:3.0:1789683500.819156:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8448a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+25:11430:x1876618835464704:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789683500.819185:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683500.819208:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889feb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc6f6 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683500.819346:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889ff2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683500.819361:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889ff2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683500.819373:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889ff2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683500.819386:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789683500.819505:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b889feb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6f6 expref: 28 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683500.819524:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889ff2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6f6 expref: 27 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683500.819534:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:3.0:1789683500.819537:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789683500.819540:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176e00, rc 0) 00000100:00100000:3.0:1789683500.819609:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8448a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+27:11430:x1876618835464704:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 455us (663us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789683500.819617:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 145 00000100:00080000:0.0:1789683500.820095:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683500.824737:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683500.824821:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835464832 00000100:00100000:3.0:1789683500.824831:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835464832 00000100:00100000:3.0:1789683500.824888:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 146 00000100:00100000:3.0:1789683500.824899:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+27:11430:x1876618835464832:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:3.0:1789683500.824967:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a000 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683500.824993:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a000 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683500.825005:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a000 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683500.825043:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a000 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683500.825050:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a000 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683500.825057:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a000 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683500.825063:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683500.825068:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a000 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683500.825075:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a000 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683500.825087:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:3.0:1789683500.825090:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683500.825095:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a000 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683500.825101:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a000 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683500.825295:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+27:11430:x1876618835464832:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 397us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683500.825309:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 146 00000100:00100000:3.0:1789683500.922632:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683500.923361:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835464960 00000100:00100000:1.0:1789683500.923373:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835464960 00000100:00100000:1.0:1789683500.923447:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:1.0:1789683500.923459:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:2404:x1876618835464960:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:1.0:1789683500.923478:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683500.923514:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf6fee0b/0xcf8485587b88a007 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc6fd expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789683500.923541:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aac6728, atime: 0x6aac6728, ctime: 0x6aac6728, blocks: 0x8 00010000:00010000:1.0:1789683500.923563:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=414s v=(0 0) 00010000:00010000:1.0:1789683500.923567:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683500.923576:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf6fee0b/0xcf8485587b88a007 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6fd expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683500.923596:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cf6fee0b/0xcf8485587b88a007 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6fd expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683500.923610:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da800, rc 0) 00000100:00100000:1.0:1789683500.923680:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:2404:x1876618835464960:12345-192.168.201.50@tcp:101:cat.0 Request processed in 223us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683500.923687:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00080000:0.0:1789683500.924407:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683500.926917:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683500.927905:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835465088 00000100:00100000:1.0:1789683500.927919:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835465088 00002000:00100000:0.0:1789683500.928019:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9f0e83eb4700 x1876618835465088/t0(0) o3->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:556/0 lens 488/0 e 0 to 0 dl 1789683511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789683500.928031:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e83eb4700 with x1876618835465088 ext(0->4095) 00002000:00010000:0.0:1789683500.928051:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0e83eb4700 00000100:00100000:0.0:1789683500.928087:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:0.0:1789683500.928096:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec036ece-1720-411a-849c-c978dbb41f8a+7:2404:x1876618835465088:12345-192.168.201.50@tcp:3:cat.0 00000100:00100000:0.0:1789683500.928514:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec036ece-1720-411a-849c-c978dbb41f8a+7:2404:x1876618835465088:12345-192.168.201.50@tcp:3:cat.0 Request processed in 417us (1607us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789683500.928523:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 4 00002000:00100000:0.0:1789683500.928531:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9f0e83eb4700 x1876618835465088/t0(0) o3->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:556/0 lens 488/4536 e 0 to 0 dl 1789683511 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789683500.928539:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e83eb4700 with x1876618835465088 ext(0->4095) 00002000:00010000:0.0:1789683500.928542:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0e83eb4700 00010000:00010000:1.0:1789683501.087658:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683501.597038:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683501.597084:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683501.597127:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683501.597159:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683501.597182:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835465344 00000100:00100000:3.0:1789683501.597183:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683501.597195:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835465344 00000100:00100000:0.0:1789683501.597265:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835465600 00000100:00100000:0.0:1789683501.597269:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835465600 00000100:00100000:0.0:1789683501.597289:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835465728 00000100:00100000:0.0:1789683501.597292:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835465728 00000100:00100000:0.0:1789683501.597312:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 303 00000100:00100000:0.0:1789683501.597320:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835465344:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683501.597392:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835465344:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 72us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683501.597399:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 303 00000100:00100000:0.0:1789683501.597419:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 304 00000100:00100000:0.0:1789683501.597426:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835465600:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683501.597430:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 305 00000100:00100000:3.0:1789683501.597442:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835465728:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683501.597458:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835465600:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 32us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683501.597478:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835465728:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 38us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683501.597492:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 304 00000100:00080000:0.0:1789683501.597512:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683501.597517:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789683501.597546:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835465216 00000100:00100000:2.0:1789683501.597551:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835465216 00000100:00100000:2.0:1789683501.597582:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 389 00000100:00100000:2.0:1789683501.597589:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:2403:x1876618835465216:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683501.597624:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:2403:x1876618835465216:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 36us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683501.597631:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 389 00000100:00100000:1.0:1789683501.597734:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835465472 00000100:00100000:1.0:1789683501.597740:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835465472 00000100:00100000:1.0:1789683501.597825:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 117 00000100:00100000:1.0:1789683501.597845:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+7:2403:x1876618835465472:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683501.597890:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+7:2403:x1876618835465472:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 58us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683501.597896:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 117 00000100:00080000:0.0:1789683501.598901:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683501.605280:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 305 00000100:00100000:0.0:1789683501.663013:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850216192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683501.663088:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683501.663175:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850216192 00000100:00100000:0.0:1789683501.663182:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850216192 00000100:00100000:0.0:1789683501.663231:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789683501.663241:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850216192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789683501.663276:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789683501.663322:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850216192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683501.663328:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789683501.663375:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850216192:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1789683501.681719:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1789683501.681738:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000040:00080000:0.0:1789683502.113555:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789683502.114238:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683502.175609:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683502.175633:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850216320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683502.175709:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683502.175958:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850216320 00000100:00100000:1.0:1789683502.175979:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850216320 00000100:00100000:1.0:1789683502.176043:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789683502.176053:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850216320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789683502.176087:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789683502.176152:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850216320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683502.176160:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1789683502.176930:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683502.176980:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850216320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683502.693517:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683502.693544:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850216448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683502.693622:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683502.693742:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850216448 00000100:00100000:0.0:1789683502.693751:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850216448 00000100:00100000:0.0:1789683502.693843:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789683502.693853:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1876618850216448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683502.693880:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789683502.693936:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1876618850216448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683502.693943:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1789683502.693975:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683502.694136:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850216448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683502.694586:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683502.694600:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850216576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683502.694638:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683502.694713:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850216576 00000100:00100000:2.0:1789683502.694720:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850216576 00000100:00100000:2.0:1789683502.694765:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789683502.694773:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850216576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683502.694832:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789683502.694875:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850216576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683502.694880:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789683502.695541:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850216576:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1789683502.696653:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1789683502.696685:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f0f88818cc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1789683502.696698:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0f8c273500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f0f88818840 00000020:00080000:2.0:1789683502.696701:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0f8c273c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f0f8553fe00 00000020:00080000:2.0:1789683502.696723:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1789683502.696736:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1789683502.696834:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1789683502.696902:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889f82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683502.696914:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889f82 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683502.696922:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889f82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683502.696928:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683502.696939:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889f82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683502.696947:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889f82 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683502.696964:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0e835a6400) 00010000:00010000:3.0:1789683502.696967:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683502.696972:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889f82 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683502.696978:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b889f82 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789683502.706940:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:0.0:1789683502.706953:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000040:00080000:1.0:1789683502.753390:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683502.753401:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683502.753423:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789683502.753433:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789683503.135064:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683504.162497:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683504.223207:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850216704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789683504.223298:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683504.223505:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850216704 00000100:00100000:1.0:1789683504.223514:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850216704 00000100:00100000:1.0:1789683504.223596:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789683504.223607:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850216704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789683504.223639:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683504.223691:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850216704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683504.223698:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789683504.223746:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850216704:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789683504.223889:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683504.738533:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683504.738661:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850216832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683504.738891:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683504.740594:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850217088:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.740653:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683504.740674:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850217600:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.740694:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683504.740855:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850218112:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.740885:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683504.740916:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789683504.740922:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850216960:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.740948:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683504.740969:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f85253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850217472:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.740991:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683504.741007:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850217984:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.741043:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683504.741084:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850217088 00000100:00100000:0.0:1789683504.741091:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850217088 00000100:00100000:0.0:1789683504.741133:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850217600 00000100:00100000:0.0:1789683504.741136:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850217600 00000100:00100000:0.0:1789683504.741162:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850218112 00000100:00100000:0.0:1789683504.741165:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850218112 00000100:00100000:0.0:1789683504.741181:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789683504.741190:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850217088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.741250:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850217088:12345-0@lo:400:kworker.0 Request processed in 61us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683504.741257:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789683504.741274:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789683504.741280:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850217600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.741305:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850217600:12345-0@lo:400:kworker.0 Request processed in 26us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683504.741311:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789683504.741321:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789683504.741326:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850218112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.741351:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850218112:12345-0@lo:400:kworker.0 Request processed in 26us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683504.741357:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789683504.741383:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850216960 00000100:00100000:0.0:1789683504.741387:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850216960 00000100:00100000:0.0:1789683504.741410:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1789683504.741415:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3650:x1876618850216960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.741444:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3650:x1876618850216960:12345-0@lo:400:kworker.0 Request processed in 29us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683504.741457:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1789683504.741487:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850217472 00000100:00100000:0.0:1789683504.741491:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850217472 00000100:00100000:0.0:1789683504.741515:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789683504.741521:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850217472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.741551:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850217472:12345-0@lo:400:kworker.0 Request processed in 31us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683504.742518:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789683504.742800:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850217984 00000100:00100000:0.0:1789683504.742807:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850217984 00000100:00100000:0.0:1789683504.742856:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789683504.742865:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850217984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.742922:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850217984:12345-0@lo:400:kworker.0 Request processed in 59us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683504.742929:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1789683504.742949:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683504.742953:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683504.742984:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f85250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850217344:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.743017:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683504.743042:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850217856:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.743116:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683504.743145:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789683504.743152:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850217216:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.743177:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683504.743196:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850217728:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.743215:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683504.743240:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850218240:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.743261:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683504.743286:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850217856 00000100:00100000:0.0:1789683504.743289:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850217856 00000100:00100000:0.0:1789683504.743320:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789683504.743326:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850217856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.743360:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850217856:12345-0@lo:400:kworker.0 Request processed in 34us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683504.743366:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789683504.743384:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850217216 00000100:00100000:0.0:1789683504.743387:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850217216 00000100:00100000:0.0:1789683504.743407:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789683504.743414:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850217216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.743444:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850217216:12345-0@lo:400:kworker.0 Request processed in 31us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683504.743450:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789683504.743470:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850217344 00000100:00100000:0.0:1789683504.743473:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850217344 00000100:00100000:0.0:1789683504.743494:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850217728 00000100:00100000:0.0:1789683504.743496:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850217728 00000100:00100000:0.0:1789683504.743512:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850218240 00000100:00100000:0.0:1789683504.743514:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850218240 00000100:00100000:0.0:1789683504.743529:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789683504.743535:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850217344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.746093:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850217344:12345-0@lo:400:kworker.0 Request processed in 2549us (3067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683504.746111:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789683504.746151:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789683504.746184:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850217728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.746265:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850217728:12345-0@lo:400:kworker.0 Request processed in 89us (3049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683504.746272:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789683504.746286:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789683504.746293:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876618850218240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.746322:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876618850218240:12345-0@lo:400:kworker.0 Request processed in 30us (3060us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683504.746327:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:0.0:1789683504.746358:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683504.746363:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683504.746420:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850217216:0@lo:400:kworker.0 00010000:00080000:0.0:1789683504.746437:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e84415500 x1876618850217728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683504.746447:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850217728:0@lo:400:kworker.0 00010000:00080000:0.0:1789683504.746456:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83f14a80 x1876618850218240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683504.746464:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850218240:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.746474:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f85250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850217344:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.746484:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850217856:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.746523:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850216960:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.746535:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f85253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850217472:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.751273:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967314 gen 2 00000004:00080000:0.0:1789683504.751287:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0e83e03b80, transno 4294967312 00000004:00080000:0.0:1789683504.751310:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967314 committed transno 4294967314 00000100:00100000:0.0:1789683504.751340:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850217984:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.751366:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850217088:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.751378:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850217600:0@lo:400:kworker.0 00000100:00100000:0.0:1789683504.751388:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850218112:0@lo:400:kworker.0 00000100:00100000:3.0:1789683504.751950:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850216832 00000100:00100000:3.0:1789683504.751959:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850216832 00000100:00080000:3.0:1789683504.752408:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683504.752461:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789683504.752472:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850216832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683504.752499:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789683504.752859:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850216832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 388us (13967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683504.752867:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789683504.752911:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1789683504.752916:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1789683504.752933:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0e8448b100, transno 4294967305 00000100:00100000:3.0:1789683504.752959:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850216832:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789683505.184549:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683506.207688:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683506.514987:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683506.515333:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835465856 00000100:00100000:2.0:1789683506.515343:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835465856 00000100:00100000:2.0:1789683506.515417:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 147 00000100:00100000:2.0:1789683506.515428:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+13:11075:x1876618835465856:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789683506.515538:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+13:11075:x1876618835465856:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 Request processed in 112us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683506.515546:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 147 00000100:00080000:3.0:1789683506.515883:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683506.536022:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683506.536152:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835465984 00000100:00100000:0.0:1789683506.536163:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835465984 00000100:00100000:0.0:1789683506.536254:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 148 00000100:00100000:0.0:1789683506.536266:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8448b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:11075:x1876618835465984:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789683506.536398:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8448b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:11075:x1876618835465984:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 Request processed in 136us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683506.536406:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 148 00000100:00080000:3.0:1789683506.536943:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683506.548057:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683506.548219:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835466240 00000100:00100000:0.0:1789683506.548233:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835466240 00000100:00100000:0.0:1789683506.548375:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00100000:0.0:1789683506.548389:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+13:11075:x1876618835466240:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789683506.548760:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+14:11075:x1876618835466240:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 373us (803us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789683506.548769:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00100000:1.0:1789683506.711356:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683506.711404:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683506.711442:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683506.711524:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835466752 00000100:00100000:0.0:1789683506.711567:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835466752 00000100:00100000:0.0:1789683506.711688:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 312 00000100:00100000:0.0:1789683506.711702:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835466752:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683506.711859:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835466752:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 159us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683506.711868:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 312 00000100:00100000:3.0:1789683506.711938:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835466368 00000100:00100000:3.0:1789683506.711972:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835466368 00000100:00080000:1.0:1789683506.711993:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683506.712048:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 391 00000100:00100000:3.0:1789683506.712072:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:2404:x1876618835466368:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683506.712162:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:2404:x1876618835466368:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 104us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683506.712171:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 391 00000100:00100000:2.0:1789683506.715936:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835466496 00000100:00100000:2.0:1789683506.715966:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835466496 00000100:00100000:2.0:1789683506.716113:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 120 00000100:00100000:2.0:1789683506.716128:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+6:2405:x1876618835466496:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683506.716242:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+6:2405:x1876618835466496:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 118us (4898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683506.716250:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 120 00000100:00080000:0.0:1789683506.717777:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683506.723103:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683506.723241:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683506.723306:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835466880 00000100:00100000:2.0:1789683506.723323:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835466880 00000100:00100000:2.0:1789683506.723833:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 313 00000100:00100000:2.0:1789683506.723869:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8448aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2404:x1876618835466880:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683506.723973:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8448aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2404:x1876618835466880:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 108us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683506.723983:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 313 00000100:00080000:2.0:1789683506.724015:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789683506.728700:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835466624 00000100:00100000:0.0:1789683506.728723:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835466624 00000100:00100000:0.0:1789683506.728932:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 121 00000100:00100000:0.0:1789683506.728947:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84488e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835466624:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683506.729072:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84488e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2404:x1876618835466624:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 129us (5988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683506.729082:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 121 00000100:00080000:2.0:1789683506.734731:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683506.784138:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683506.784173:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e836a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850218368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683506.784277:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683506.785991:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850218368 00000100:00100000:0.0:1789683506.786010:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850218368 00000100:00100000:0.0:1789683506.786114:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789683506.786129:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850218368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789683506.786194:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789683506.786337:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850218368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 211us (2059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683506.786345:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789683506.786734:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e836a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850218368:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789683507.231799:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683507.295269:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683507.295311:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850218496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683507.295425:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683507.295922:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850218496 00000100:00100000:1.0:1789683507.295937:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850218496 00000100:00100000:1.0:1789683507.296038:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789683507.296052:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850218496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789683507.296097:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789683507.296166:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850218496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683507.296174:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1789683507.296321:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683507.296612:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850218496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683507.808376:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683507.808398:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850218624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683507.808480:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683507.808552:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850218624 00000100:00100000:3.0:1789683507.808561:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850218624 00000100:00100000:3.0:1789683507.808646:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789683507.808655:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850218624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683507.808680:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789683507.808725:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850218624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683507.808733:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1789683507.808753:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683507.808809:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850218624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683507.809060:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683507.809075:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850218752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789683507.809107:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683507.809209:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850218752 00000100:00100000:0.0:1789683507.809215:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850218752 00000100:00100000:0.0:1789683507.809251:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789683507.809259:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850218752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789683507.809297:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789683507.809340:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850218752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683507.809346:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789683507.809376:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850218752:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789683508.257947:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789683508.366317:0:14568:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 18:18:27 (1789683507) 00000001:00080000:3.0:1789683508.833290:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1789683508.833308:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1789683508.833373:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1789683508.833386:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1789683509.280640:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683509.344110:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683509.344137:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e84488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850218880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683509.344232:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683509.344429:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850218880 00000100:00100000:1.0:1789683509.344440:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850218880 00000100:00100000:1.0:1789683509.344521:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789683509.344533:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850218880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789683509.344565:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683509.344612:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850218880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683509.344619:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1789683509.344844:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683509.344881:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e84488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850218880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683509.607391:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683509.607518:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835467136 00000100:00100000:0.0:1789683509.607530:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835467136 00000100:00100000:0.0:1789683509.607610:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 149 00000100:00100000:0.0:1789683509.607621:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+13:12148:x1876618835467136:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683509.607644:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683509.607666:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a00e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc704 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.607754:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a015 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.607768:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a015 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.607813:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a015 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.607830:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a01c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.607858:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a01c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.607865:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a01c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.607969:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a023 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.607986:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a023 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.607994:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a023 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683509.608005:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789683509.608094:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a015 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.608102:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a015 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.608110:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a015 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.608116:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683509.608119:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a015 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.608126:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a015 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.608151:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f0f83e0b400) 00010000:00010000:0.0:1789683509.608153:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683509.608159:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a015 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.608166:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a015 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.608179:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a01c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.608185:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a01c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.608191:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a01c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.608196:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683509.608199:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a01c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.608205:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a01c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.608212:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f0e835a6700) 00010000:00010000:0.0:1789683509.608214:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683509.608217:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a01c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.608222:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a01c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.609152:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a00e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc704 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.609175:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a023 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc704 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.609182:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0f854c2c00) 00010000:00010000:0.0:1789683509.609185:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683509.609188:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454de00, rc 0) 00000100:00100000:0.0:1789683509.609260:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+15:12148:x1876618835467136:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 1641us (1877us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789683509.609269:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 149 00000100:00080000:3.0:1789683509.609358:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683509.613219:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683509.614148:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835467264 00000100:00100000:2.0:1789683509.614167:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835467264 00000100:00100000:2.0:1789683509.614246:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 150 00000100:00100000:2.0:1789683509.614257:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+15:12148:x1876618835467264:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789683509.614362:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+15:12148:x1876618835467264:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 Request processed in 106us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683509.614369:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 150 00000100:00100000:2.0:1789683509.616641:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683509.616876:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835467392 00000100:00100000:1.0:1789683509.616886:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835467392 00000100:00100000:1.0:1789683509.616957:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 151 00000100:00100000:1.0:1789683509.616967:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8448a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:12148:x1876618835467392:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1789683509.617069:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683509.617084:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8448a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:12148:x1876618835467392:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 Request processed in 119us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683509.617107:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 151 00000100:00100000:1.0:1789683509.624046:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683509.624146:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835467520 00000100:00100000:0.0:1789683509.624158:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835467520 00000100:00100000:0.0:1789683509.624227:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:0.0:1789683509.624239:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+15:2402:x1876618835467520:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683509.624268:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683509.624293:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a023 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc704 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683509.624312:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0f854c2c00) 00010000:00010000:0.0:1789683509.624317:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683509.624376:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+14:2402:x1876618835467520:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 140us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683509.624384:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:1.0:1789683509.855184:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e844ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850219392:0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.855269:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683509.855323:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e844de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850219904:0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.855361:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683509.855380:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e844dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850220416:0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.855401:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683509.855427:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789683509.855445:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e844dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850219264:0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.855470:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683509.855487:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e844dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850219776:0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.855506:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683509.855521:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e844de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850220288:0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.855539:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683509.855570:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850219392 00000100:00100000:1.0:1789683509.855577:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850219392 00000100:00100000:1.0:1789683509.855620:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850219776 00000100:00100000:1.0:1789683509.855623:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850219776 00000100:00100000:1.0:1789683509.855647:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850220288 00000100:00100000:1.0:1789683509.855649:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850220288 00000100:00100000:1.0:1789683509.855683:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789683509.855691:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e844dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850219392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.855742:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e844dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850219392:12345-0@lo:400:kworker.0 Request processed in 51us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683509.855761:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789683509.855781:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789683509.855819:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e844df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850219776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.855850:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e844df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850219776:12345-0@lo:400:kworker.0 Request processed in 33us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683509.855855:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789683509.855867:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789683509.855872:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e844df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876618850220288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.855896:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e844df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876618850220288:12345-0@lo:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683509.855901:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789683509.855918:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850219904 00000100:00100000:1.0:1789683509.855922:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850219904 00000100:00100000:1.0:1789683509.855947:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850220416 00000100:00100000:1.0:1789683509.855949:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850220416 00000100:00100000:1.0:1789683509.855981:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789683509.855988:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e844ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850219904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.856018:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e844ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850219904:12345-0@lo:400:kworker.0 Request processed in 31us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683509.856024:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789683509.856035:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789683509.856041:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e844dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850220416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.856065:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e844dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850220416:12345-0@lo:400:kworker.0 Request processed in 25us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683509.856069:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:1.0:1789683509.856129:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e844dc700 x1876618850219776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683509.856145:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e844dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850219776:0@lo:400:kworker.0 00010000:00080000:1.0:1789683509.856156:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e844de300 x1876618850220288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683509.856165:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e844de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850220288:0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.856174:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e844ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850219392:0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.856181:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e844de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850219904:0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.856190:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e844dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850220416:0@lo:400:kworker.0 00000100:00100000:0.0:1789683509.856516:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e844dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850219136:0@lo:400:kworker.0 00000100:00100000:0.0:1789683509.856548:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683509.856577:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e844dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850219648:0@lo:400:kworker.0 00000100:00100000:0.0:1789683509.856595:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683509.856618:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e844dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850220160:0@lo:400:kworker.0 00000100:00100000:0.0:1789683509.856636:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683509.856662:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789683509.856669:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e844ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850219008:0@lo:400:kworker.0 00000100:00100000:0.0:1789683509.856695:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683509.856716:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e844df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850219520:0@lo:400:kworker.0 00000100:00100000:0.0:1789683509.856735:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683509.856751:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e844dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850220032:0@lo:400:kworker.0 00000100:00100000:0.0:1789683509.856770:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683509.856817:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850219008 00000100:00100000:0.0:1789683509.856822:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850219008 00000100:00100000:0.0:1789683509.856855:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1789683509.856862:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3650:x1876618850219008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683509.856898:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3650:x1876618850219008:12345-0@lo:400:kworker.0 Request processed in 36us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683509.856904:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1789683509.856931:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850219264 00000100:00100000:0.0:1789683509.856935:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850219264 00000100:00100000:0.0:1789683509.856956:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850219520 00000100:00100000:0.0:1789683509.856959:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850219520 00000100:00100000:0.0:1789683509.856983:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789683509.856990:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e844dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850219264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683509.857034:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e844dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850219264:12345-0@lo:400:kworker.0 Request processed in 44us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683509.857040:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789683509.857053:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789683509.857058:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850219520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683509.857086:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850219520:12345-0@lo:400:kworker.0 Request processed in 27us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683509.857090:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789683509.857106:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850220032 00000100:00100000:0.0:1789683509.857110:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850220032 00000100:00100000:0.0:1789683509.857130:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789683509.857135:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850220032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683509.857162:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850220032:12345-0@lo:400:kworker.0 Request processed in 27us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683509.857166:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789683509.857196:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e844ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850219008:0@lo:400:kworker.0 00000100:00100000:0.0:1789683509.857206:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e844df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850219520:0@lo:400:kworker.0 00000100:00100000:0.0:1789683509.857214:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e844dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850220032:0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.857565:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850219136 00000100:00100000:1.0:1789683509.857569:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850219136 00000100:00100000:1.0:1789683509.857601:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850219648 00000100:00100000:1.0:1789683509.857605:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850219648 00000100:00100000:1.0:1789683509.857619:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850220160 00000100:00100000:1.0:1789683509.857622:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850220160 00000100:00100000:1.0:1789683509.857636:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789683509.857642:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850219136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.857694:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850219136:12345-0@lo:400:kworker.0 Request processed in 53us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683509.857700:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789683509.857712:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789683509.857718:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850219648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.857742:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850219648:12345-0@lo:400:kworker.0 Request processed in 26us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683509.857757:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789683509.857769:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789683509.857775:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850220160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.857830:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850220160:12345-0@lo:400:kworker.0 Request processed in 56us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683509.857836:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789683509.857870:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e844dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850219136:0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.857879:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e844dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850219648:0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.857887:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e844dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850220160:0@lo:400:kworker.0 00000100:00100000:1.0:1789683509.857910:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e844dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850219264:0@lo:400:kworker.0 00000100:00080000:3.0:1789683509.859391:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683509.859398:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789683509.859401:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789683509.859405:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683509.875382:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683509.875407:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e836a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850220544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683509.875511:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683509.878993:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850220544 00000100:00100000:2.0:1789683509.879008:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850220544 00000100:00100000:2.0:1789683509.879074:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789683509.879084:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbe544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850220544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683509.879110:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683509.879202:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbe544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850220544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (3691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683509.879227:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789683509.880965:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e836a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850220544:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789683509.921984:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789683509.921994:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789683509.923087:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789683509.923103:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789683510.304507:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789683510.305653:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683511.326963:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683511.468420:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683511.468611:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835467648 00000100:00100000:1.0:1789683511.468623:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835467648 00000100:00100000:1.0:1789683511.468702:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 152 00000100:00100000:1.0:1789683511.468716:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+14:12190:x1876618835467648:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789683511.468741:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683511.468770:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a031 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc70b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789683511.468972:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789683511.469076:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a038 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469093:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a038 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469106:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a038 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469125:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a03f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469133:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a03f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469140:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a03f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469201:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a038 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469209:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a038 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469217:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a038 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469236:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837daa00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683511.469241:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a038 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469260:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a038 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469272:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e826a2500) 00010000:00010000:1.0:1789683511.469274:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683511.469279:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a038 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469284:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a038 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469297:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a03f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469302:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a03f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469308:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a03f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469313:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837db600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683511.469316:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a03f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469322:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a03f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469330:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f0fb8504300) 00010000:00010000:1.0:1789683511.469332:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683511.469335:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a03f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469351:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a03f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469386:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a031 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc70b expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469396:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e826a2500) 00010000:00010000:1.0:1789683511.469398:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683511.469402:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a031 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc70b expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.469411:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da200, rc 0) 00000100:00100000:1.0:1789683511.469676:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+14:12190:x1876618835467648:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 961us (1262us total) trans 0 rc 301/301 00000100:00100000:1.0:1789683511.469683:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 152 00000100:00100000:3.0:1789683511.486513:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683511.486548:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835467904 00000100:00100000:3.0:1789683511.486558:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835467904 00000100:00100000:3.0:1789683511.486610:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 153 00000100:00100000:3.0:1789683511.486620:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+14:12190:x1876618835467904:12345-192.168.201.50@tcp:36:lfs.0 00010000:00010000:3.0:1789683511.486677:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683511.486705:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b889993 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc536 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.486722:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e826a2500) 00010000:00010000:3.0:1789683511.486734:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683511.486811:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b88a046 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.486825:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b88a046 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.486836:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b88a046 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.486855:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a04d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.486863:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a04d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.486883:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a04d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.487387:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a054 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.487397:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.487404:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683511.487419:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096ef1f67 reply state 00000000ff13ca0c transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.487430:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a054 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.487436:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:3.0:1789683511.487439:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789683511.487442:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789683511.487446:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789683511.487454:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b88a046 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.487461:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b88a046 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.487473:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b88a046 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.487480:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683511.487484:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b88a046 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.487492:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b88a046 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.487500:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fc11eb400) 00010000:00010000:3.0:1789683511.487503:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683511.487506:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b88a046 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.487513:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b88a046 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683511.487526:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096ef1f67 reply state 00000000ff13ca0c transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a04d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.487534:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a04d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.487540:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f0fc11eb300) 00010000:00010000:3.0:1789683511.487542:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789683511.487545:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789683511.487626:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+15:12190:x1876618835467904:12345-192.168.201.50@tcp:36:lfs.0 Request processed in 1006us (1120us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789683511.487635:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 153 00000100:00100000:3.0:1789683511.570211:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683511.571424:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835468032 00000100:00100000:0.0:1789683511.571437:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835468032 00000100:00100000:0.0:1789683511.571519:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 154 00000100:00100000:0.0:1789683511.571530:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+15:12198:x1876618835468032:12345-192.168.201.50@tcp:101:lctl.0 00010000:00010000:0.0:1789683511.571554:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683511.571579:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a05b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc712 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.571677:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88a062 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.571693:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88a062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.571708:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88a062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683511.571777:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789683511.571836:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683511.571864:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88a062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.571892:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a05b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc712 expref: 17 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.571910:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88a062 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc712 expref: 16 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.571920:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e835a6200) 00010000:00010000:0.0:1789683511.571923:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683511.571926:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454ce00, rc 0) 00000100:00100000:0.0:1789683511.572151:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+16:12198:x1876618835468032:12345-192.168.201.50@tcp:101:lctl.0 Request processed in 622us (1951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683511.572159:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 154 00000100:00100000:3.0:1789683511.663321:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683511.663452:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835468160 00000100:00100000:2.0:1789683511.663464:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835468160 00000100:00100000:2.0:1789683511.663523:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 155 00000100:00100000:2.0:1789683511.663533:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+16:12204:x1876618835468160:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683511.663557:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683511.663583:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a069 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc719 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.663667:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a070 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.663684:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a070 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.663696:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a070 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.663707:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a077 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.663714:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a077 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.663721:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a077 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.663883:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88a07e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.663892:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88a07e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.663899:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88a07e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683511.663943:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789683511.663948:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683511.663971:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88a07e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.663984:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a070 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.663991:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a070 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.663999:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a070 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.664055:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683511.664060:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a070 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.664068:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a070 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.664080:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e835a6200) 00010000:00010000:2.0:1789683511.664089:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683511.664095:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a070 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.664101:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a070 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.664114:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a077 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.664120:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a077 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.664126:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a077 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.664131:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683511.664134:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a077 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.664140:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a077 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.664148:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f0fc11eb300) 00010000:00010000:2.0:1789683511.664150:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683511.664153:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a077 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.664159:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a077 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.664185:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a069 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc719 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.664210:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88a07e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc719 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.664217:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:2.0:1789683511.664220:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789683511.664223:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31600, rc 0) 00000100:00100000:2.0:1789683511.664290:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+17:12204:x1876618835468160:12345-192.168.201.50@tcp:101:bash.0 Request processed in 758us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683511.664298:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 155 00000100:00100000:3.0:1789683511.667243:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683511.667395:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835468416 00000100:00100000:0.0:1789683511.667415:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835468416 00000100:00100000:0.0:1789683511.667489:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 156 00000100:00100000:0.0:1789683511.667499:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+17:12204:x1876618835468416:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789683511.667522:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683511.667541:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a085 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc720 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.667645:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a08c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.667659:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a08c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.667671:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a08c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.667685:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a093 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.667691:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a093 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.667697:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a093 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789683511.668065:0:12533:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789683511.668212:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a09a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.668222:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a09a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.668230:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a09a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.668270:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a08c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.668278:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a08c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.668284:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a08c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.668291:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454c600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683511.668295:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a08c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.668302:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a08c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.668314:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:0.0:1789683511.668317:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683511.668323:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a08c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.668330:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a08c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789683511.668341:0:12533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc9f94c5 reply state 00000000db8cc28f transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a093 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.668351:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a093 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.668357:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0e835a6a00) 00010000:00010000:0.0:1789683511.668364:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789683511.668367:0:12533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789683511.668395:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a085 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc720 expref: 20 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.668410:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a09a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc720 expref: 19 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.668417:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0e835a6600) 00010000:00010000:0.0:1789683511.668419:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683511.668422:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d000, rc 0) 00000100:00100000:0.0:1789683511.668494:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+20:12204:x1876618835468416:12345-192.168.201.50@tcp:101:bash.0 Request processed in 995us (1259us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1789683511.668502:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 156 00000100:00100000:1.0:1789683511.675752:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683511.675892:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835468544 00000100:00100000:2.0:1789683511.675904:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835468544 00000100:00100000:2.0:1789683511.675993:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:2.0:1789683511.676005:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e844dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835468544:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683511.676025:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683511.676046:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ba0074/0xcf8485587b88a0a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc727 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789683511.676070:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683511.676090:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1789683511.676095:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683511.676104:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ba0074/0xcf8485587b88a0a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc727 expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.676123:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ba0074/0xcf8485587b88a0a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc727 expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.676156:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31c00, rc 0) 00000100:00100000:2.0:1789683511.676207:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e844dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835468544:12345-192.168.201.50@tcp:101:bash.0 Request processed in 205us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683511.676214:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00080000:0.0:1789683511.676407:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789683511.685864:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683511.692421:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835468672 00000100:00100000:1.0:1789683511.692439:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835468672 00000100:00100000:1.0:1789683511.692512:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:1.0:1789683511.692522:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:12204:x1876618835468672:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:1.0:1789683511.692545:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683511.692565:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b88a0af lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc72e expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.692596:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2ba0074/0xcf8485587b88a0a8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc727 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.692624:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683511.692630:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683511.692636:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b88a0af lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc72e expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.692672:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2ba0074/0xcf8485587b88a0a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc727 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.692828:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2ba0074/0xcf8485587b88a0a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc727 expref: 7 pid: 8437 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683511.692843:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e844dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1876618850220672:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789683511.693056:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683511.696301:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e844dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1876618850220672:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789683511.696339:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b88a0af lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc72e expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.696361:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837db600, rc 0) 00000100:00100000:1.0:1789683511.696429:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:12204:x1876618835468672:12345-192.168.201.50@tcp:101:bash.0 Request processed in 3908us (10575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683511.696438:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:3.0:1789683511.696580:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683511.697184:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835468800 00000100:00100000:1.0:1789683511.697193:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835468800 00010000:00010000:1.0:1789683511.697227:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ba0074/0xcf8485587b88a0a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc727 expref: 7 pid: 8437 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683511.697279:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 81 00000100:00100000:1.0:1789683511.697290:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84421180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:2403:x1876618835468800:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683511.697305:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683511.697327:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2ba0074/0xcf8485587b88a0a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc727 expref: 7 pid: 8437 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.697340:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2ba0074/0xcf8485587b88a0a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc727 expref: 7 pid: 8437 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.697361:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ba0074/0xcf8485587b88a0a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc727 expref: 7 pid: 8437 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.697376:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683511.697381:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683511.697389:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b88a0af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc72e expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.697409:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b88a0af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc72e expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.697443:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b88a0af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc72e expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683511.697458:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e844dd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6507:1876618850220800:192.168.201.50@tcp:105: 00000100:00100000:1.0:1789683511.697528:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683511.707293:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683511.707542:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e844dd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6507:1876618850220800:192.168.201.50@tcp:105: 00010000:00010000:1.0:1789683511.707564:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683511.707640:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84421180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:2403:x1876618835468800:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 10350us (11059us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683511.707652:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 81 00000100:00100000:2.0:1789683511.709669:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835469056 00000100:00100000:2.0:1789683511.709693:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835469056 00000100:00100000:2.0:1789683511.709855:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 36 00000100:00100000:2.0:1789683511.709867:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+20:12204:x1876618835469056:12345-192.168.201.50@tcp:35:bash.0 00000100:00100000:2.0:1789683511.710205:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+21:12204:x1876618835469056:12345-192.168.201.50@tcp:35:bash.0 Request processed in 340us (2919us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1789683511.710213:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 36 00000100:00100000:3.0:1789683511.803425:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683511.803625:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835469312 00000100:00100000:1.0:1789683511.803636:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835469312 00000100:00100000:1.0:1789683511.803717:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 157 00000100:00100000:1.0:1789683511.803728:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+21:12214:x1876618835469312:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789683511.803754:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683511.803776:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a0b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc735 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683511.803927:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789683511.804045:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a0b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc735 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.804059:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e835a6200) 00010000:00010000:1.0:1789683511.804062:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789683511.804067:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a0b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc735 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.804080:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837daa00, rc 0) 00000100:00100000:1.0:1789683511.804137:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+22:12214:x1876618835469312:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 411us (732us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1789683511.804144:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 157 00000100:00100000:3.0:1789683511.811864:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683511.812062:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835469568 00000100:00100000:0.0:1789683511.812074:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835469568 00000100:00100000:0.0:1789683511.812132:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 37 00000100:00100000:0.0:1789683511.812142:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+22:12214:x1876618835469568:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:0.0:1789683511.812520:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+23:12214:x1876618835469568:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 254us (540us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789683511.812529:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 37 00000100:00100000:2.0:1789683511.830259:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683511.830300:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683511.830326:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683511.830349:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683511.830371:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683511.830568:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835470080 00000100:00100000:1.0:1789683511.830579:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835470080 00000100:00100000:1.0:1789683511.830629:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835469952 00000100:00100000:1.0:1789683511.830632:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835469952 00000100:00100000:1.0:1789683511.830673:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 125 00000100:00100000:1.0:1789683511.830682:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835470080:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683511.830754:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835470080:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 73us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683511.830762:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 125 00000100:00100000:1.0:1789683511.830779:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 126 00000100:00100000:1.0:1789683511.830821:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835469952:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683511.830845:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+6:2402:x1876618835469952:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683511.830851:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 126 00000100:00100000:2.0:1789683511.830969:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683511.831321:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835469696 00000100:00100000:2.0:1789683511.831327:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835469696 00000100:00100000:2.0:1789683511.831361:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 393 00000100:00100000:2.0:1789683511.831368:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:2402:x1876618835469696:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683511.831551:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+13:2402:x1876618835469696:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 183us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683511.831576:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 393 00000100:00100000:1.0:1789683511.831843:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835469824 00000100:00100000:1.0:1789683511.831848:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835469824 00000100:00100000:1.0:1789683511.831883:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835470336 00000100:00100000:1.0:1789683511.831886:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835470336 00000100:00100000:1.0:1789683511.831902:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835470208 00000100:00100000:1.0:1789683511.831905:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835470208 00000100:00100000:1.0:1789683511.831920:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 320 00000100:00100000:1.0:1789683511.831926:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835469824:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683511.831974:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2402:x1876618835469824:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 47us (1725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683511.831980:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 320 00000100:00100000:1.0:1789683511.831995:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 321 00000100:00100000:1.0:1789683511.832001:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835470336:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683511.832035:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835470336:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 34us (1708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683511.832041:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 321 00000100:00100000:1.0:1789683511.832053:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 322 00000100:00100000:1.0:1789683511.832059:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835470208:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683511.832080:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835470208:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 22us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683511.832085:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 322 00000100:00080000:0.0:1789683511.832980:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683511.832985:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683511.832988:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683511.896978:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683511.897103:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835470464 00000100:00100000:1.0:1789683511.897114:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835470464 00000100:00100000:1.0:1789683511.897290:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 158 00000100:00100000:1.0:1789683511.897302:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+23:12220:x1876618835470464:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789683511.897331:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683511.897356:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a0c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc73c expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.897581:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a0cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.897599:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a0cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.897612:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a0cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683511.897828:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789683511.897833:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789683511.897870:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a0cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.897900:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a0c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc73c expref: 25 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.897920:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a0cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc73c expref: 24 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.897929:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:1.0:1789683511.897941:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683511.897945:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dbc00, rc 0) 00000100:00100000:1.0:1789683511.898051:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+24:12220:x1876618835470464:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 752us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683511.898058:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 158 00000100:00100000:0.0:1789683511.903030:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e836a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850220928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683511.903097:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683511.903172:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850220928 00000100:00100000:0.0:1789683511.903192:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850220928 00000100:00100000:0.0:1789683511.903251:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789683511.903261:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850220928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789683511.903296:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789683511.903341:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850220928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683511.903347:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789683511.903405:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e836a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850220928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683511.904634:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683511.904860:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835470720 00000100:00100000:2.0:1789683511.904869:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835470720 00000100:00100000:2.0:1789683511.904963:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 159 00000100:00100000:2.0:1789683511.904974:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+24:12220:x1876618835470720:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683511.904992:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683511.905014:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a0d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc743 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.905128:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a0d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.905141:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.905155:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683511.905167:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789683511.905300:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a0d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc743 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.905320:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a0d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc743 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.905328:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0e835a6600) 00010000:00010000:2.0:1789683511.905332:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683511.905348:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31200, rc 0) 00000100:00100000:2.0:1789683511.905415:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+26:12220:x1876618835470720:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 444us (788us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1789683511.905423:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 159 00000100:00100000:3.0:1789683511.909633:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683511.911042:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683511.911075:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835471104 00000100:00100000:3.0:1789683511.911087:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835471104 00000100:00100000:3.0:1789683511.911150:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:3.0:1789683511.911161:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+26:2402:x1876618835471104:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683511.911179:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683511.911206:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a0d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc743 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.911236:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0e835a6600) 00010000:00010000:3.0:1789683511.911241:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683511.911294:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+25:2402:x1876618835471104:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 134us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683511.911302:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:1.0:1789683511.912346:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835470976 00000100:00100000:1.0:1789683511.912357:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835470976 00000100:00100000:1.0:1789683511.912631:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 160 00000100:00100000:1.0:1789683511.912640:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+25:12220:x1876618835470976:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789683511.912672:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683511.912691:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a0e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc74a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.912809:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a0ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.912823:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a0ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.912835:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a0ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683511.912861:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789683511.912979:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a0e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc74a expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.912996:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a0ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc74a expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.913004:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0e835a6600) 00010000:00010000:1.0:1789683511.913007:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789683511.913010:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dac00, rc 0) 00000100:00100000:1.0:1789683511.913058:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+27:12220:x1876618835470976:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 420us (3436us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1789683511.913064:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 160 00000100:00100000:3.0:1789683511.918042:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683511.918082:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835471232 00000100:00100000:3.0:1789683511.918092:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835471232 00000100:00100000:3.0:1789683511.918138:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:3.0:1789683511.918147:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+6:2404:x1876618835471232:12345-192.168.201.50@tcp:1:lfs.0 00010000:00010000:3.0:1789683511.918201:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a0fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.918233:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b88a0af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc72e expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.918242:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683511.918247:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683511.918251:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a0fc lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.918281:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b88a0af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc72e expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.918294:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b88a0af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc72e expref: 6 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683511.918309:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1876618850221056:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789683511.918383:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a28e480 going to sleep for 11 seconds 00000100:00100000:3.0:1789683511.922068:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1876618850221056:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789683511.922099:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a0fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683511.924163:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683511.924252:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835471360 00000100:00100000:1.0:1789683511.924262:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835471360 00002000:00100000:1.0:1789683511.924318:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9f0e82fe6a00 x1876618835471360/t0(0) o4->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:567/0 lens 504/0 e 0 to 0 dl 1789683522 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789683511.924330:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e82fe6a00 with x1876618835471360 ext(0->12) 00010000:00010000:1.0:1789683511.924340:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b88a0af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc72e expref: 7 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.924356:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b88a0af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc72e expref: 7 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789683511.924364:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f0e82fe6a00 00000100:00100000:1.0:1789683511.924407:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:1.0:1789683511.924438:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:2402:x1876618835471360:12345-192.168.201.50@tcp:4:lfs.0 00000100:00100000:1.0:1789683511.925807:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec036ece-1720-411a-849c-c978dbb41f8a+9:2402:x1876618835471360:12345-192.168.201.50@tcp:4:lfs.0 Request processed in 1339us (1621us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789683511.925824:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 2 00002000:00100000:1.0:1789683511.925837:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9f0e82fe6a00 x1876618835471360/t4294967306(0) o4->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:567/0 lens 504/448 e 0 to 0 dl 1789683522 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789683511.925846:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e82fe6a00 with x1876618835471360 ext(0->12) 00010000:00010000:1.0:1789683511.925856:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b88a0af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc72e expref: 9 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.925874:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b88a0af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc72e expref: 9 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789683511.925882:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f0e82fe6a00 00000100:00100000:2.0:1789683511.928227:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683511.928305:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835471488 00000100:00100000:3.0:1789683511.928330:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835471488 00010000:00010000:3.0:1789683511.928366:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b88a0af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc72e expref: 9 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683511.928418:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 82 00000100:00100000:3.0:1789683511.928428:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+9:2403:x1876618835471488:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683511.928446:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789683511.928469:0:6508:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789683511.928473:0:6508:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789683512 00002000:00010000:3.0:1789683511.928475:0:6508:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789683512 00002000:00010000:3.0:1789683511.928478:0:6508:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789683512 00002000:00010000:3.0:1789683511.928480:0:6508:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789683511.928487:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b88a0af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc72e expref: 9 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.928501:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b88a0af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc72e expref: 9 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.928528:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f0c9864/0xcf8485587b88a0af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc72e expref: 9 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.928550:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683511.928554:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683511.928561:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a0fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.928572:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a0fc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.928620:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683511.928688:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+8:2403:x1876618835471488:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 262us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683511.928696:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 82 00010000:00010000:0.0:1789683511.928826:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a0fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.928837:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a0fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.928856:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a0fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.928863:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a0fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.928872:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a0fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.928879:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683511.928883:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a0fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.928900:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a0fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.928912:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a0fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.928920:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a0fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683511.928975:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:2404:x1876618835471232:12345-192.168.201.50@tcp:1:lfs.0 Request processed in 10829us (10941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683511.928982:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:3.0:1789683511.931853:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683511.931928:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835471744 00000100:00100000:0.0:1789683511.931947:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835471744 00000100:00100000:0.0:1789683511.932001:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 38 00000100:00100000:0.0:1789683511.932011:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f867ca450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+27:12220:x1876618835471744:12345-192.168.201.50@tcp:35:lfs.0 00000004:00010000:0.0:1789683511.932072:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a0ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc74a expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789683511.932299:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1789683511.932328:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1789683511.932635:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1789683511.932671:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a103 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.932686:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a09a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc720 expref: 31 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.932701:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a103 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.932734:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a09a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc720 expref: 31 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.932749:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a09a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc720 expref: 31 pid: 12533 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683511.932763:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e836a6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1876618850221184:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789683511.932885:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e92840 going to sleep for 11 seconds 00000100:00100000:0.0:1789683511.935890:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683511.936037:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835471872 00000100:00100000:3.0:1789683511.936048:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835471872 00010000:00010000:3.0:1789683511.936087:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a09a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc720 expref: 32 pid: 12533 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683511.936088:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e836a6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1876618850221184:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683511.936111:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a103 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683511.936129:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 83 00000100:00100000:3.0:1789683511.936138:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+32:2403:x1876618835471872:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683511.936152:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683511.936160:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a09a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc720 expref: 32 pid: 12533 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.936172:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a09a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc720 expref: 32 pid: 12533 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.936193:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a09a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc720 expref: 32 pid: 12533 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.936208:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0e835a6600) 00010000:00010000:3.0:1789683511.936213:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a103 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.936252:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a103 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.936259:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a103 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.936286:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683511.936330:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+31:2403:x1876618835471872:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 193us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683511.936337:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 83 00010000:00010000:2.0:1789683511.936455:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a103 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.936463:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a103 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789683511.936571:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1789683511.936701:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1789683511.936813:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d41880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1876618850221312:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789683511.936862:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683511.937081:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f830b5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683511.937132:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850221312 00000100:00100000:0.0:1789683511.937138:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850221312 00000100:00100000:0.0:1789683511.937188:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789683511.937195:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1876618850221312:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789683511.937292:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1876618850221312:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 97us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683511.937299:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789683511.937444:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d41880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1876618850221312:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789683511.937567:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1789683511.937612:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e81d41880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1876618850221440:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789683511.937642:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683511.937665:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f899f9600 going to sleep for 11 seconds 00000100:00100000:0.0:1789683511.937781:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850221440 00000100:00100000:0.0:1789683511.937813:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850221440 00000100:00100000:0.0:1789683511.937843:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789683511.937850:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1876618850221440:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789683511.937959:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6525:x1876618850221440:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 109us (316us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789683511.937981:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:2.0:1789683511.938147:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683511.938473:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e81d41880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1876618850221440:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789683511.938518:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1789683511.938552:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a103 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.938560:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a103 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.938567:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a103 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.938572:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683511.938576:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a103 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.938590:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a103 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.938605:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0e835a6600) 00010000:00010000:3.0:1789683511.938608:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789683511.938613:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a103 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.938619:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a103 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789683511.938718:0:6525:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789683511.938773:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1789683511.938812:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 425988027774ns, next at 426987996662ns, rc = 0 00000001:00080000:3.0:1789683511.938819:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1789683511.938840:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0e835a6600) 00010000:00010000:3.0:1789683511.938843:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789683511.938850:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a0ee lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc74a expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683511.938950:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f867ca450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+34:12220:x1876618835471744:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 6940us (7106us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1789683511.938958:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 38 00000020:00080000:3.0:1789683511.938962:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789683511.943057:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683511.943153:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835472000 00000100:00100000:1.0:1789683511.943168:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835472000 00000100:00100000:1.0:1789683511.943252:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 161 00000100:00100000:1.0:1789683511.943265:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+34:12220:x1876618835472000:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789683511.943298:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683511.943325:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a10a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc751 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.943390:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a10a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc751 expref: 35 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.943406:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a10a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc751 expref: 35 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683511.943444:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:1.0:1789683511.943447:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789683511.943466:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da200, rc 0) 00000100:00100000:1.0:1789683511.943533:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+35:12220:x1876618835472000:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 270us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683511.943540:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 161 00000100:00100000:2.0:1789683511.946949:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683511.947034:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835472256 00000100:00100000:3.0:1789683511.947045:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835472256 00000100:00100000:3.0:1789683511.947124:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 39 00000100:00100000:3.0:1789683511.947133:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+35:12220:x1876618835472256:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789683511.947371:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+36:12220:x1876618835472256:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 238us (441us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789683511.947379:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 39 00000100:00100000:2.0:1789683512.041353:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683512.041835:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835472512 00000100:00100000:1.0:1789683512.041850:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835472512 00000100:00100000:1.0:1789683512.041995:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 162 00000100:00100000:1.0:1789683512.042008:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+36:12230:x1876618835472512:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789683512.042035:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683512.042064:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a111 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc758 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683512.042173:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789683512.042594:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a111 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc758 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683512.042609:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e835a6200) 00010000:00010000:1.0:1789683512.042613:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789683512.042619:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a111 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc758 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683512.042635:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dac00, rc 0) 00000100:00100000:1.0:1789683512.042744:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+37:12230:x1876618835472512:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 738us (1401us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1789683512.042768:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 162 00000100:00100000:0.0:1789683512.047829:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683512.048164:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835472640 00000100:00100000:3.0:1789683512.048176:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835472640 00000100:00100000:3.0:1789683512.048347:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 163 00000100:00100000:3.0:1789683512.048359:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+37:12230:x1876618835472640:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:3.0:1789683512.048591:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a11f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.048610:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a11f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.048627:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a11f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.048640:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a126 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.048647:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a126 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.048654:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a126 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.048744:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a12d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.048753:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a12d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.048781:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a12d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683512.048954:0:12533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a12d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.048969:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a11f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.048976:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a11f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.048984:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a11f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.048991:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683512.048995:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a11f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.049003:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a11f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.049014:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:3.0:1789683512.049017:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683512.049022:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a11f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.049028:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a11f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.049041:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a126 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.049054:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a126 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.049060:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a126 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.049064:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683512.049067:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a126 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.049072:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a126 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.049079:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0e835a6a00) 00010000:00010000:3.0:1789683512.049081:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683512.049084:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a126 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.049089:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a126 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.049097:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a12d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.049103:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a12d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.049108:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a12d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.049113:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683512.049121:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a12d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.049127:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a12d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.049134:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:3.0:1789683512.049136:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683512.049139:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a12d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.049144:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a12d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683512.049318:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+37:12230:x1876618835472640:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 959us (2546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683512.049326:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 163 00000100:00100000:2.0:1789683512.052547:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683512.052641:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835472896 00000100:00100000:3.0:1789683512.052652:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835472896 00000100:00100000:3.0:1789683512.052746:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 40 00000100:00100000:3.0:1789683512.052757:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+37:12230:x1876618835472896:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789683512.053052:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+38:12230:x1876618835472896:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 296us (513us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789683512.053060:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 40 00000100:00100000:3.0:1789683512.132961:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683512.138841:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835473152 00000100:00100000:2.0:1789683512.138858:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835473152 00000100:00100000:2.0:1789683512.139141:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 164 00000100:00100000:2.0:1789683512.139152:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+38:12233:x1876618835473152:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683512.139178:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683512.139206:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a134 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc75f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.139284:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a13b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.139300:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a13b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.139312:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a13b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.139323:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a142 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.139331:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.139338:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.139455:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a149 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.139464:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.139471:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683512.139481:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789683512.139568:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a13b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.139589:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a13b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.139596:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a13b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.139602:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683512.139607:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a13b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.139615:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a13b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.139628:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:2.0:1789683512.139632:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683512.139638:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a13b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.141781:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a13b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.141837:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.141845:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a142 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.141853:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a142 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.141860:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683512.141882:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a142 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.141891:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a142 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.141988:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0e835a6a00) 00010000:00010000:2.0:1789683512.141991:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683512.141998:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a142 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.142005:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a142 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.142073:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a134 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc75f expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.142089:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a149 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc75f expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.142097:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:2.0:1789683512.142100:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683512.142103:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31c00, rc 0) 00000100:00100000:2.0:1789683512.142186:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+40:12233:x1876618835473152:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 3035us (9400us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789683512.142196:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 164 00000100:00100000:0.0:1789683512.150187:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683512.150770:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835473280 00000100:00100000:1.0:1789683512.150818:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835473280 00000100:00100000:0.0:1789683512.151125:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 165 00000100:00100000:0.0:1789683512.151140:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+40:12233:x1876618835473280:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:0.0:1789683512.151211:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a157 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683512.151229:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683512.151242:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683512.151279:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683512.151287:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a157 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683512.151294:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a157 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683512.151300:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683512.151304:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a157 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683512.151311:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a157 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683512.151342:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:0.0:1789683512.151344:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789683512.151350:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a157 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683512.151355:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a157 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683512.151439:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+40:12233:x1876618835473280:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 303us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683512.151447:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 165 00000100:00100000:3.0:1789683512.154152:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683512.162039:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835473536 00000100:00100000:2.0:1789683512.162058:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835473536 00000100:00100000:2.0:1789683512.162142:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00100000:2.0:1789683512.162155:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+40:12233:x1876618835473536:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:2.0:1789683512.162641:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+41:12233:x1876618835473536:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 487us (8495us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789683512.162662:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 41 00000040:00080000:1.0:1789683512.351865:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789683512.354176:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683512.415081:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e844dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850221568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683512.415164:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683512.415297:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850221568 00000100:00100000:0.0:1789683512.415306:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850221568 00000100:00100000:0.0:1789683512.415379:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789683512.415400:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850221568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789683512.415433:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789683512.415480:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850221568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683512.415487:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1789683512.415778:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683512.415839:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e844dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850221568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683512.556565:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683512.556724:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835473792 00000100:00100000:3.0:1789683512.556737:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835473792 00000100:00100000:3.0:1789683512.556852:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 166 00000100:00100000:3.0:1789683512.556864:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e844dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+41:12264:x1876618835473792:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:3.0:1789683512.556891:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683512.556912:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a15e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc766 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.557040:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a165 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.557059:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.557072:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683512.557085:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789683512.557197:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a15e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc766 expref: 44 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.557219:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a165 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc766 expref: 43 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.557229:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:3.0:1789683512.557232:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683512.557236:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176c00, rc 0) 00000100:00100000:3.0:1789683512.557307:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e844dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+43:12264:x1876618835473792:12345-192.168.201.50@tcp:101:cat.0 Request processed in 445us (752us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1789683512.557315:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 166 00000100:00100000:0.0:1789683512.578204:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683512.578306:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835474048 00000100:00100000:3.0:1789683512.578341:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835474048 00000100:00100000:3.0:1789683512.578410:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 42 00000100:00100000:3.0:1789683512.578421:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+43:12264:x1876618835474048:12345-192.168.201.50@tcp:35:cat.0 00000100:00100000:3.0:1789683512.578666:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+44:12264:x1876618835474048:12345-192.168.201.50@tcp:35:cat.0 Request processed in 247us (473us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789683512.578673:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 42 00000100:00100000:2.0:1789683512.581613:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683512.581996:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835474176 00000100:00100000:1.0:1789683512.582008:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835474176 00000100:00100000:1.0:1789683512.582088:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:1.0:1789683512.582100:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+44:2404:x1876618835474176:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683512.582120:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683512.582147:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a165 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc766 expref: 44 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683512.582169:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:1.0:1789683512.582175:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683512.582250:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+43:2404:x1876618835474176:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 151us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683512.582258:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:1.0:1789683512.688670:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683512.688773:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835474432 00000100:00100000:2.0:1789683512.688821:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835474432 00000100:00100000:2.0:1789683512.688902:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 167 00000100:00100000:2.0:1789683512.688913:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e844dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+43:12270:x1876618835474432:12345-192.168.201.50@tcp:101:dd.0 00010000:00010000:2.0:1789683512.688968:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683512.688971:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789683512.688997:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a0cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc73c expref: 43 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.689015:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:2.0:1789683512.689020:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683512.689033:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a173 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc76d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.689139:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a17a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.689155:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a149 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc75f expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.689180:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a17a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.689229:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a149 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc75f expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.689243:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a149 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc75f expref: 43 pid: 6523 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683512.689257:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876618850221696:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683512.689365:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f830b5840 going to sleep for 11 seconds 00000100:00100000:1.0:1789683512.693461:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683512.693666:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835474560 00000100:00100000:3.0:1789683512.693675:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835474560 00010000:00010000:3.0:1789683512.693716:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a149 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc75f expref: 44 pid: 6523 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683512.693760:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 84 00000100:00100000:3.0:1789683512.693772:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84444c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+44:2402:x1876618835474560:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683512.693815:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683512.693824:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a149 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc75f expref: 44 pid: 6523 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.693837:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a149 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc75f expref: 44 pid: 6523 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.693859:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:3.0:1789683512.693865:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a17a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.693890:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a17a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.693898:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a17a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.693944:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683512.694281:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a149 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc75f expref: 44 pid: 6523 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683512.694300:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876618850221696:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683512.694326:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a17a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.694336:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a17a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.694341:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a17a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683512.694363:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789683512.694749:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a173 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc76d expref: 45 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.694800:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a17a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc76d expref: 44 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.694810:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:2.0:1789683512.694813:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789683512.694816:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30800, rc 0) 00000100:00100000:3.0:1789683512.704432:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84444c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+44:2402:x1876618835474560:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 10651us (10970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683512.704449:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 84 00000100:00100000:2.0:1789683512.705404:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e844dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+43:12270:x1876618835474432:12345-192.168.201.50@tcp:101:dd.0 Request processed in 16486us (16738us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789683512.705414:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 167 00000100:00100000:0.0:1789683512.707356:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683512.707582:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835474688 00000100:00100000:3.0:1789683512.707593:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835474688 00000100:00100000:3.0:1789683512.707654:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 168 00000100:00100000:3.0:1789683512.707663:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+43:12270:x1876618835474688:12345-192.168.201.50@tcp:101:dd.0 00010000:00010000:3.0:1789683512.707690:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683512.707712:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a188 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc774 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.707754:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a18f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.707769:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a18f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.713727:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a18f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.714167:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a188 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc774 expref: 45 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.714192:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a18f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc774 expref: 44 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683512.714202:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:3.0:1789683512.714212:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789683512.714217:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6177200, rc 0) 00000100:00100000:3.0:1789683512.714292:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+44:12270:x1876618835474688:12345-192.168.201.50@tcp:101:dd.0 Request processed in 6628us (6943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683512.714302:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 168 00000100:00100000:0.0:1789683512.718719:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683512.718817:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835474944 00000100:00100000:2.0:1789683512.718828:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835474944 00000100:00100000:2.0:1789683512.718910:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 169 00000100:00100000:2.0:1789683512.718930:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+44:12270:x1876618835474944:12345-192.168.201.50@tcp:36:dd.0 00010000:00010000:2.0:1789683512.719178:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a196 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.719198:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.719211:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789683512.719255:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1789683512.719278:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf4a085a reply state 00000000aa717d98 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.719290:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a196 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683512.719313:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:2.0:1789683512.719315:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789683512.719319:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683512.719405:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+47:12270:x1876618835474944:12345-192.168.201.50@tcp:36:dd.0 Request processed in 486us (696us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1789683512.719413:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 169 00000020:00080000:2.0:1789683512.719419:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789683512.927054:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850221824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683512.927148:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683512.927178:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850221952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683512.927213:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683512.927251:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850221952 00000100:00100000:0.0:1789683512.927261:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850221952 00000100:00100000:0.0:1789683512.927314:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789683512.927348:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850221952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789683512.927388:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789683512.927437:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850221952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683512.927569:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850221952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789683512.927643:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850221824 00000100:00100000:2.0:1789683512.927648:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850221824 00000100:00100000:2.0:1789683512.927696:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789683512.927703:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850221824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789683512.927717:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789683512.927753:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850221824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683512.927759:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789683512.927819:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850221824:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789683512.928016:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683512.935158:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000040:00080000:0.0:1789683512.991380:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789683512.991390:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789683512.991488:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1789683512.991496:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789683513.200503:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683513.200605:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835475072 00000100:00100000:2.0:1789683513.200617:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835475072 00000100:00100000:2.0:1789683513.200700:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 170 00000100:00100000:2.0:1789683513.200713:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e844dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+47:12284:x1876618835475072:12345-192.168.201.50@tcp:101:stat.0 00010000:00010000:2.0:1789683513.200737:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683513.200759:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a19d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc77b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.201168:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a1a4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.201203:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a1a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.201218:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a1a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.201231:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.201238:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.201244:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.201322:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a1b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.201334:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a17a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc76d expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.201343:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a1b2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.201380:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a17a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc76d expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.201394:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a17a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc76d expref: 48 pid: 6523 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683513.201419:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0708e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876618850222080:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683513.201515:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f830b5840 going to sleep for 11 seconds 00000100:00080000:1.0:1789683513.201599:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683513.209355:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683513.209462:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835475328 00000100:00100000:0.0:1789683513.209472:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835475328 00000100:00100000:0.0:1789683513.209534:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:0.0:1789683513.209544:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc070ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+49:6172:x1876618835475328:12345-192.168.201.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789683513.210300:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0708e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876618850222080:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789683513.210329:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a1b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683513.210382:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc070ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+50:6172:x1876618835475328:12345-192.168.201.50@tcp:35:ldlm_bl.0 Request processed in 838us (1036us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1789683513.210390:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:0.0:1789683513.219239:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683513.219347:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835475456 00000100:00100000:1.0:1789683513.219358:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835475456 00010000:00010000:1.0:1789683513.219428:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a17a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc76d expref: 50 pid: 6523 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683513.219473:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 85 00000100:00100000:1.0:1789683513.219483:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+50:2404:x1876618835475456:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683513.219500:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683513.219507:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a17a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc76d expref: 50 pid: 6523 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.219520:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a17a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc76d expref: 50 pid: 6523 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.219544:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a17a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc76d expref: 50 pid: 6523 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.219562:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:1.0:1789683513.219568:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a1b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.219578:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.219585:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a1b2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.219632:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683513.219688:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+49:2404:x1876618835475456:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 206us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683513.219696:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 85 00010000:00010000:2.0:1789683513.220268:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220278:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683513.220338:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789683513.220342:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683513.220363:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220389:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220399:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a1a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220405:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a1a4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220411:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a1a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220416:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683513.220420:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a1a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220438:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a1a4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220448:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:2.0:1789683513.220452:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683513.220456:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a1a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220462:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a1a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220474:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220479:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220484:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220490:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683513.220493:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220498:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220505:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0e835a6a00) 00010000:00010000:2.0:1789683513.220508:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683513.220511:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220526:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220559:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a19d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc77b expref: 49 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220572:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a1b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc77b expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.220578:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:2.0:1789683513.220581:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683513.220584:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30e00, rc 0) 00000100:00100000:2.0:1789683513.220732:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e844dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+48:12284:x1876618835475072:12345-192.168.201.50@tcp:101:stat.0 Request processed in 19915us (20133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683513.220740:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 170 00000100:00100000:0.0:1789683513.298575:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683513.303558:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835475712 00000100:00100000:1.0:1789683513.303580:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835475712 00000100:00100000:1.0:1789683513.303661:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 171 00000100:00100000:1.0:1789683513.303672:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+48:12290:x1876618835475712:12345-192.168.201.50@tcp:36:truncate.0 00010000:00010000:1.0:1789683513.303730:0:12533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683513.303757:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a1b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc77b expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.303777:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:1.0:1789683513.303832:0:12533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789683513.304028:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a1b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.304043:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a1b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.304053:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a1b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789683513.304097:0:12533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1789683513.304118:0:12533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4af7262 reply state 00000000d6498aad transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a1b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.304130:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a1b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.304137:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:1.0:1789683513.304140:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789683513.304143:0:12533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789683513.304258:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+50:12290:x1876618835475712:12345-192.168.201.50@tcp:36:truncate.0 Request processed in 586us (5695us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1789683513.304281:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 171 00000020:00080000:1.0:1789683513.304287:0:12533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789683513.375240:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683513.546389:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683513.546550:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835475840 00000100:00100000:0.0:1789683513.546562:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835475840 00000100:00100000:0.0:1789683513.546629:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 172 00000100:00100000:0.0:1789683513.546640:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e844de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+50:12304:x1876618835475840:12345-192.168.201.50@tcp:101:stat.0 00010000:00010000:0.0:1789683513.546669:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683513.546693:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88a1c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc782 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.546774:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a1c7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.546857:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a1c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.546871:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a1c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.546886:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a1ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.546893:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a1ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.546900:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a1ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547003:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a1d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547012:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547020:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683513.547068:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789683513.547073:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683513.547096:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547110:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547129:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a1c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547136:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a1c7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547143:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a1c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547149:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683513.547153:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a1c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547161:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a1c7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547173:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:0.0:1789683513.547176:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683513.547182:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a1c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547187:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a1c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547200:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a1ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547206:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a1ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547211:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a1ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547223:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454de00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683513.547226:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a1ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547232:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a1ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547241:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0e835a6a00) 00010000:00010000:0.0:1789683513.547243:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683513.547246:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a1ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547253:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a1ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547279:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88a1c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc782 expref: 52 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547295:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a1d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc782 expref: 51 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.547302:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:0.0:1789683513.547304:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683513.547307:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454c600, rc 0) 00000100:00100000:0.0:1789683513.547389:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e844de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+51:12304:x1876618835475840:12345-192.168.201.50@tcp:101:stat.0 Request processed in 751us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683513.547397:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 172 00000100:00100000:3.0:1789683513.658185:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683513.658291:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835476096 00000100:00100000:2.0:1789683513.658302:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835476096 00000100:00100000:2.0:1789683513.658367:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 173 00000100:00100000:2.0:1789683513.658389:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e81d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+51:12314:x1876618835476096:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683513.658411:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683513.658432:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a1dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc789 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683513.658543:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789683513.658645:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a1dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc789 expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.658677:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e835a6200) 00010000:00010000:2.0:1789683513.658680:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789683513.658686:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a1dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc789 expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.658699:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31c00, rc 0) 00000100:00100000:2.0:1789683513.658767:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e81d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+52:12314:x1876618835476096:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 381us (593us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1789683513.658775:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 173 00000100:00100000:1.0:1789683513.662031:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683513.662117:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835476352 00000100:00100000:2.0:1789683513.662128:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835476352 00000100:00100000:2.0:1789683513.662204:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 44 00000100:00100000:2.0:1789683513.662216:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f867c9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+52:12314:x1876618835476352:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:2.0:1789683513.662462:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f867c9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+53:12314:x1876618835476352:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 249us (441us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1789683513.662470:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 44 00000100:00100000:3.0:1789683513.738298:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683513.738369:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835476608 00000100:00100000:2.0:1789683513.738467:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835476608 00000100:00100000:2.0:1789683513.738611:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 174 00000100:00100000:2.0:1789683513.738634:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+53:12320:x1876618835476608:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683513.738658:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683513.738679:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a1ea lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc790 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.738876:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.738911:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a1d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc782 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.738921:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1f1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.738956:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a1d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc782 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.738969:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a1d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc782 expref: 54 pid: 6522 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683513.738984:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850222208:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683513.739073:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f830b53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683513.743150:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683513.743238:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835476736 00000100:00100000:0.0:1789683513.743261:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835476736 00010000:00010000:0.0:1789683513.743306:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a1d5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc782 expref: 55 pid: 6522 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683513.743355:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 86 00000100:00100000:0.0:1789683513.743364:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84488700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+55:2402:x1876618835476736:12345-192.168.201.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789683513.743413:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850222208:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683513.743438:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.743535:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683513.743543:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a1d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc782 expref: 55 pid: 6522 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.743555:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a1d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc782 expref: 55 pid: 6522 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.743576:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a1d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc782 expref: 55 pid: 6522 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.743592:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:0.0:1789683513.743596:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.743605:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.743613:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1f1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.743771:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683513.743932:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84488700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+54:2402:x1876618835476736:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 567us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683513.743950:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 86 00010000:00010000:2.0:1789683513.745729:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.745747:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683513.745895:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789683513.746080:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a1ea lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc790 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.746125:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc790 expref: 54 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.746136:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:2.0:1789683513.746141:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789683513.746146:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30a00, rc 0) 00000100:00100000:2.0:1789683513.746236:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+54:12320:x1876618835476608:12345-192.168.201.50@tcp:101:bash.0 Request processed in 7605us (7947us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789683513.746246:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 174 00000100:00100000:3.0:1789683513.753124:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683513.753691:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835476992 00000100:00100000:1.0:1789683513.753703:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835476992 00000100:00100000:1.0:1789683513.753766:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 175 00000100:00100000:1.0:1789683513.754917:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+54:12320:x1876618835476992:12345-192.168.201.50@tcp:36:bash.0 00010000:00010000:1.0:1789683513.755185:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a1ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.755205:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a1ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.755217:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a1ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789683513.755259:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1789683513.755281:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b156535 reply state 00000000d5ba5fd1 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a1ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.755294:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a1ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.755302:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:1.0:1789683513.755305:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789683513.755309:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789683513.755559:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+57:12320:x1876618835476992:12345-192.168.201.50@tcp:36:bash.0 Request processed in 1782us (2444us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1789683513.755591:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 175 00000020:00080000:1.0:1789683513.755597:0:8462:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789683513.766160:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683513.766260:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835477120 00000100:00100000:2.0:1789683513.766273:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835477120 00000100:00100000:2.0:1789683513.766336:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 176 00000100:00100000:2.0:1789683513.766348:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+57:12320:x1876618835477120:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683513.766383:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683513.766405:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a206 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc797 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.766505:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a20d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.766520:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1f1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc790 expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.766529:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a20d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.766561:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc790 expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.766588:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc790 expref: 58 pid: 6521 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683513.766603:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876618850222336:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683513.766689:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f830b53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683513.770382:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683513.770514:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876618850222336:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683513.770542:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a20d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683513.770914:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835477248 00000100:00100000:1.0:1789683513.770922:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835477248 00010000:00010000:1.0:1789683513.770962:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc790 expref: 59 pid: 6521 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683513.771001:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 87 00000100:00100000:1.0:1789683513.771011:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84422680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+59:2402:x1876618835477248:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683513.771028:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683513.771035:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc790 expref: 59 pid: 6521 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.771049:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc790 expref: 59 pid: 6521 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.771071:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a1f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc790 expref: 59 pid: 6521 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.771089:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:1.0:1789683513.771094:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a20d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.771103:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a20d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.771113:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a20d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.771164:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683513.771233:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84422680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+58:2402:x1876618835477248:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 221us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683513.771241:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 87 00010000:00010000:2.0:1789683513.771308:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a20d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.771317:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a20d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683513.771377:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789683513.771382:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683513.771404:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a20d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.771434:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a206 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc797 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.771463:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a20d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc797 expref: 57 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.771471:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:2.0:1789683513.771481:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683513.771484:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31800, rc 0) 00000100:00100000:2.0:1789683513.771509:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+57:12320:x1876618835477120:12345-192.168.201.50@tcp:101:bash.0 Request processed in 5164us (5362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683513.771516:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 176 00000100:00100000:3.0:1789683513.782199:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683513.782304:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835477504 00000100:00100000:2.0:1789683513.782314:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835477504 00000100:00100000:2.0:1789683513.782389:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 45 00000100:00100000:2.0:1789683513.782402:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+57:12320:x1876618835477504:12345-192.168.201.50@tcp:35:bash.0 00000100:00100000:2.0:1789683513.782634:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+58:12320:x1876618835477504:12345-192.168.201.50@tcp:35:bash.0 Request processed in 234us (457us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789683513.782641:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 45 00000100:00100000:0.0:1789683513.876259:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683513.877572:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835477760 00000100:00100000:2.0:1789683513.877590:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835477760 00000100:00100000:2.0:1789683513.877675:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 177 00000100:00100000:2.0:1789683513.877689:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+58:12330:x1876618835477760:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683513.877725:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683513.877753:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a214 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc79e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683513.877933:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789683513.878049:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a214 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc79e expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.878066:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e835a6200) 00010000:00010000:2.0:1789683513.878070:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789683513.878076:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a214 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc79e expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.878110:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31c00, rc 0) 00000100:00100000:2.0:1789683513.878195:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+59:12330:x1876618835477760:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 509us (1948us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1789683513.878203:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 177 00000100:00100000:3.0:1789683513.883310:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683513.885470:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835477888 00000100:00100000:1.0:1789683513.885487:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835477888 00000100:00100000:1.0:1789683513.885598:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 178 00000100:00100000:1.0:1789683513.885610:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+59:12330:x1876618835477888:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:1.0:1789683513.885695:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a222 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.885712:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a222 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.885725:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a222 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.885737:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a229 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.885745:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a229 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.885751:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a229 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.885865:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a230 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.885884:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a230 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.885918:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a230 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789683513.885970:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a230 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.885983:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a222 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.885990:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a222 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.885997:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a222 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.886003:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837db600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683513.886008:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a222 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.886015:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a222 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.886027:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:1.0:1789683513.886030:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683513.886035:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a222 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.886042:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a222 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.886055:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a229 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.886068:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a229 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.886075:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a229 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.886080:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dac00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683513.886083:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a229 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.886089:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a229 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.886098:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0e835a6a00) 00010000:00010000:1.0:1789683513.886101:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683513.886104:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a229 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.886111:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a229 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.886121:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a230 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.886127:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a230 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.886133:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a230 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.886138:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81391400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683513.886147:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a230 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.886154:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a230 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.886161:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:1.0:1789683513.886164:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683513.886167:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a230 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683513.886173:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a230 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683513.886263:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+59:12330:x1876618835477888:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 655us (2964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683513.886271:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 178 00000100:00100000:3.0:1789683513.888559:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683513.888834:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835478144 00000100:00100000:2.0:1789683513.888847:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835478144 00000100:00100000:2.0:1789683513.889058:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 46 00000100:00100000:2.0:1789683513.889071:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+59:12330:x1876618835478144:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:2.0:1789683513.889296:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+60:12330:x1876618835478144:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 228us (746us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789683513.889304:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 46 00000100:00100000:3.0:1789683513.925122:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683513.925219:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835478400 00000100:00100000:2.0:1789683513.925231:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835478400 00000100:00100000:2.0:1789683513.925296:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 179 00000100:00100000:2.0:1789683513.925306:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+60:12334:x1876618835478400:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683513.925334:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683513.925356:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a237 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc7a5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.925428:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88a23e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.925441:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88a23e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.925452:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88a23e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.925477:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a245 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.925484:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.925490:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.925589:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a24c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.925598:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a24c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.925604:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a24c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683513.925737:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789683513.925978:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88a23e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.925986:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88a23e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.925993:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88a23e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.925999:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683513.926003:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88a23e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.926022:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88a23e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.926035:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:2.0:1789683513.926039:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683513.926046:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88a23e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.926052:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88a23e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.926064:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.926069:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a245 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.926075:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a245 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.926079:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683513.926081:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a245 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.926087:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a245 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.926094:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0e835a6a00) 00010000:00010000:2.0:1789683513.926096:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683513.926098:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a245 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.926114:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a245 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.926154:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a237 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7a5 expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.926168:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a24c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7a5 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.926176:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:2.0:1789683513.926179:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683513.926181:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30e00, rc 0) 00000100:00100000:2.0:1789683513.926243:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+62:12334:x1876618835478400:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 938us (1134us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789683513.926250:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 179 00000100:00100000:3.0:1789683513.930692:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683513.930737:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683513.930859:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835478528 00000100:00100000:2.0:1789683513.930872:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835478528 00000100:00100000:2.0:1789683513.930938:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 180 00000100:00100000:2.0:1789683513.930949:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+62:12334:x1876618835478528:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:2.0:1789683513.931027:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a25a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.931044:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a25a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.931058:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a25a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.931108:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a25a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.931115:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a25a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.931123:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a25a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.931130:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683513.931134:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a25a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.931141:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a25a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.931154:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:2.0:1789683513.931157:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789683513.931163:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a25a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683513.931169:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a25a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683513.931293:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835478656 00000100:00100000:0.0:1789683513.931298:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835478656 00000100:00100000:0.0:1789683513.931339:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:0.0:1789683513.931348:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+63:2405:x1876618835478656:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683513.931366:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683513.931384:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a24c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7a5 expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683513.931396:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:0.0:1789683513.931399:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683513.932663:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+62:12334:x1876618835478528:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 1711us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683513.932674:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 180 00000100:00100000:0.0:1789683513.932795:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+61:2405:x1876618835478656:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 1434us (2043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683513.932804:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:3.0:1789683513.939421:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683513.940098:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835478912 00000100:00100000:2.0:1789683513.940110:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835478912 00000100:00100000:2.0:1789683513.940284:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:2.0:1789683513.940308:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+61:12334:x1876618835478912:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:2.0:1789683513.940567:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+62:12334:x1876618835478912:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 260us (5242us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789683513.940575:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:1.0:1789683514.086325:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683514.086463:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835479168 00000100:00100000:3.0:1789683514.086475:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835479168 00000100:00100000:3.0:1789683514.086540:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 181 00000100:00100000:3.0:1789683514.086551:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e844ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+62:12352:x1876618835479168:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:3.0:1789683514.086596:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683514.086620:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a261 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc7ac expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683514.086739:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88a268 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683514.086756:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88a268 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683514.086770:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88a268 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683514.086815:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789683514.086952:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a261 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7ac expref: 65 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683514.086974:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88a268 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7ac expref: 64 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683514.086983:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:3.0:1789683514.086986:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789683514.086991:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176200, rc 0) 00000100:00100000:3.0:1789683514.087069:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e844ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+64:12352:x1876618835479168:12345-192.168.201.50@tcp:101:cat.0 Request processed in 519us (755us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1789683514.087077:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 181 00000100:00100000:1.0:1789683514.112474:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683514.112569:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835479296 00000100:00100000:2.0:1789683514.112580:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835479296 00000100:00100000:2.0:1789683514.112642:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 182 00000100:00100000:2.0:1789683514.112652:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e844de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+64:12353:x1876618835479296:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683514.112677:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683514.112693:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a276 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc7b3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.112746:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a27d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.112757:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a27d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.112766:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a27d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683514.112839:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789683514.112842:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683514.113025:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a27d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.113054:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a276 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7b3 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.113093:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a27d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7b3 expref: 65 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.113102:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:2.0:1789683514.113105:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683514.113109:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31c00, rc 0) 00000100:00100000:2.0:1789683514.113216:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e844de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+65:12353:x1876618835479296:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 564us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683514.113223:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 182 00000100:00100000:1.0:1789683514.121348:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683514.121482:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835479680 00000100:00100000:3.0:1789683514.121492:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835479680 00000100:00100000:3.0:1789683514.121553:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:3.0:1789683514.121578:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e844dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+65:12353:x1876618835479680:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789683514.121936:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e844dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+66:12353:x1876618835479680:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 360us (596us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789683514.121945:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:1.0:1789683514.123971:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683514.124090:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835479808 00000100:00100000:2.0:1789683514.124100:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835479808 00000100:00100000:2.0:1789683514.124267:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:2.0:1789683514.124277:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e844dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+66:12353:x1876618835479808:12345-192.168.201.50@tcp:103:lfs.0 00010000:00010000:2.0:1789683514.124292:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789683514.124318:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a20d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc797 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.124338:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88a268 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7ac expref: 65 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.124349:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a10a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc751 expref: 64 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.124358:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:2.0:1789683514.124363:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683514.124509:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e844dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+63:12353:x1876618835479808:12345-192.168.201.50@tcp:103:lfs.0 Request processed in 233us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683514.124517:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:1.0:1789683514.126882:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683514.127034:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835479936 00000100:00100000:3.0:1789683514.127043:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835479936 00000100:00100000:3.0:1789683514.127101:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 183 00000100:00100000:3.0:1789683514.127112:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e844dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+63:12353:x1876618835479936:12345-192.168.201.50@tcp:58:lfs.0 00010000:00010000:3.0:1789683514.127257:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a284 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683514.127276:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a284 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683514.127289:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a284 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789683514.127401:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789683514.127495:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e844dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+63:12353:x1876618835479936:12345-192.168.201.50@tcp:58:lfs.0 Request processed in 384us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683514.127503:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 183 00000100:00100000:1.0:1789683514.153993:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683514.154105:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835480064 00000100:00100000:0.0:1789683514.154116:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835480064 00000100:00100000:0.0:1789683514.154195:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 184 00000100:00100000:0.0:1789683514.154206:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e844df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+63:12355:x1876618835480064:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789683514.154226:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683514.154248:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a28b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc7ba expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154315:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a292 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154330:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a292 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154523:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a292 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154538:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a299 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154545:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154552:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154619:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a2a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154628:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154635:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683514.154677:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789683514.154682:0:12533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683514.154703:0:12533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154715:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154724:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a292 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154739:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a292 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154746:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a292 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154753:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683514.154757:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a292 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154765:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a292 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154778:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:0.0:1789683514.154828:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683514.154833:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a292 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154840:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a292 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154991:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.154998:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a299 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.155004:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a299 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.155009:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683514.155019:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a299 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.155026:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a299 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.155034:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0e835a6a00) 00010000:00010000:0.0:1789683514.155037:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683514.155040:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a299 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.155047:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a299 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.155074:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a28b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7ba expref: 65 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.155087:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7ba expref: 64 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.155094:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:0.0:1789683514.155097:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683514.155099:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d000, rc 0) 00000100:00100000:0.0:1789683514.155153:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e844df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+64:12355:x1876618835480064:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 950us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683514.155161:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 184 00010000:00010000:1.0:1789683514.400287:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683514.464681:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850222464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789683514.464760:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683514.464911:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850222464 00000100:00100000:3.0:1789683514.464920:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850222464 00000100:00100000:3.0:1789683514.464996:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789683514.465007:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850222464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789683514.465041:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789683514.465089:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850222464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683514.465110:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1789683514.465183:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683514.465226:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850222464:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1789683514.928742:0:14715:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789683514.928754:0:14715:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789683514.928805:0:14715:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789683514.928812:0:14715:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:0.0:1789683514.976325:0:9861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 429025537985ns, next at 430025535404ns, rc = 0 00000100:00100000:0.0:1789683514.976360:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683514.976378:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850222592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683514.976440:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683514.976969:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850222592 00000100:00100000:3.0:1789683514.976978:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850222592 00000100:00100000:3.0:1789683514.977037:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789683514.977046:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1876618850222592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683514.977074:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789683514.977121:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1876618850222592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683514.977128:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789683514.977153:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850222848:0@lo:400:kworker.0 00000100:00100000:3.0:1789683514.977193:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683514.977218:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850223360:0@lo:400:kworker.0 00000100:00100000:3.0:1789683514.977237:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683514.977257:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850223872:0@lo:400:kworker.0 00000100:00100000:3.0:1789683514.977274:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683514.977292:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789683514.977297:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850222976:0@lo:400:kworker.0 00000100:00100000:3.0:1789683514.977322:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683514.977346:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850223488:0@lo:400:kworker.0 00000100:00100000:3.0:1789683514.977366:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683514.977382:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850224000:0@lo:400:kworker.0 00000100:00100000:3.0:1789683514.977399:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789683514.977426:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683514.977441:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850222848 00000100:00100000:3.0:1789683514.977445:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850222848 00000100:00100000:3.0:1789683514.977473:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850223360 00000100:00100000:3.0:1789683514.977475:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850223360 00000100:00100000:3.0:1789683514.977493:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850223872 00000100:00100000:3.0:1789683514.977495:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850223872 00000100:00100000:3.0:1789683514.977505:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850223488 00000100:00100000:3.0:1789683514.977507:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850223488 00000100:00100000:3.0:1789683514.977517:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850224000 00000100:00100000:3.0:1789683514.977519:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850224000 00000100:00100000:3.0:1789683514.977529:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789683514.977534:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850222848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683514.977565:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850222848:12345-0@lo:400:kworker.0 Request processed in 31us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683514.977570:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789683514.977581:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789683514.977586:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850223360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683514.977605:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850223360:12345-0@lo:400:kworker.0 Request processed in 20us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683514.977610:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789683514.977617:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789683514.977622:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850223872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683514.977641:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850223872:12345-0@lo:400:kworker.0 Request processed in 20us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683514.977646:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789683514.977654:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789683514.977658:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850223488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683514.977677:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850223488:12345-0@lo:400:kworker.0 Request processed in 19us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683514.977691:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789683514.977703:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789683514.977709:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850224000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683514.977735:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850224000:12345-0@lo:400:kworker.0 Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683514.977740:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789683514.977764:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850222976 00000100:00100000:3.0:1789683514.977768:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850222976 00000100:00100000:3.0:1789683514.977811:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789683514.977817:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850222976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683514.977847:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850222976:12345-0@lo:400:kworker.0 Request processed in 30us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683514.977852:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:3.0:1789683514.977886:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789683514.977889:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683514.977914:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850222976:0@lo:400:kworker.0 00010000:00080000:3.0:1789683514.977927:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e8445d500 x1876618850223488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683514.977938:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850223488:0@lo:400:kworker.0 00010000:00080000:3.0:1789683514.977946:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0725880 x1876618850224000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683514.977954:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850224000:0@lo:400:kworker.0 00000100:00100000:3.0:1789683514.977962:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850222848:0@lo:400:kworker.0 00000100:00100000:3.0:1789683514.977969:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850223360:0@lo:400:kworker.0 00000100:00100000:3.0:1789683514.977986:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850223872:0@lo:400:kworker.0 00000100:00100000:1.0:1789683514.978432:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850223104:0@lo:400:kworker.0 00000100:00100000:1.0:1789683514.978467:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683514.978504:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850223616:0@lo:400:kworker.0 00000100:00100000:1.0:1789683514.978533:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683514.978557:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850224128:0@lo:400:kworker.0 00000100:00100000:1.0:1789683514.978587:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683514.978612:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789683514.978619:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850222720:0@lo:400:kworker.0 00000100:00100000:1.0:1789683514.978650:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683514.978673:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850223232:0@lo:400:kworker.0 00000100:00100000:1.0:1789683514.978696:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683514.978714:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850223744:0@lo:400:kworker.0 00000100:00100000:1.0:1789683514.978733:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683514.978760:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850223616 00000100:00100000:1.0:1789683514.978765:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850223616 00000100:00100000:0.0:1789683514.979650:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850222592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683514.979854:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850223232 00000100:00100000:0.0:1789683514.979861:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850223232 00000100:00100000:0.0:1789683514.979910:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789683514.979918:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850223232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683514.979982:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850223232:12345-0@lo:400:kworker.0 Request processed in 66us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683514.979989:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789683514.980011:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850222720 00000100:00100000:0.0:1789683514.980015:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850222720 00000100:00100000:0.0:1789683514.980041:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1789683514.980047:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850222720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683514.980078:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850222720:12345-0@lo:400:kworker.0 Request processed in 32us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683514.980085:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1789683514.980112:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850224128 00000100:00100000:0.0:1789683514.980116:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850224128 00000100:00100000:0.0:1789683514.980136:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850223744 00000100:00100000:0.0:1789683514.980139:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850223744 00000100:00100000:0.0:1789683514.980173:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789683514.980180:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850224128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683514.980222:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850224128:12345-0@lo:400:kworker.0 Request processed in 43us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683514.980238:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789683514.980250:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789683514.980256:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850223744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683514.980287:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850223744:12345-0@lo:400:kworker.0 Request processed in 32us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683514.980293:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789683514.980526:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789683514.980535:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f852eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850223616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683514.980569:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f852eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850223616:12345-0@lo:400:kworker.0 Request processed in 35us (2035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683514.980575:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1789683514.980595:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683514.980618:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850222720:0@lo:400:kworker.0 00000100:00100000:1.0:1789683514.980630:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850223232:0@lo:400:kworker.0 00000100:00100000:1.0:1789683514.980641:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850223744:0@lo:400:kworker.0 00000100:00100000:1.0:1789683514.980652:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850223616:0@lo:400:kworker.0 00000100:00100000:1.0:1789683514.980662:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850224128:0@lo:400:kworker.0 00000100:00100000:3.0:1789683514.980928:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850223104 00000100:00100000:3.0:1789683514.980935:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850223104 00000100:00100000:3.0:1789683514.980969:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789683514.980976:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e844ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850223104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683514.981021:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e844ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850223104:12345-0@lo:400:kworker.0 Request processed in 46us (2554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683514.981027:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789683514.981059:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850223104:0@lo:400:kworker.0 00000004:00080000:0.0:1789683514.986832:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:0.0:1789683514.986873:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:0.0:1789683514.986933:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789683514.986943:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f0f8a28e6c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789683514.986948:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0e83faac00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f0f8a28e480 00000020:00080000:0.0:1789683514.986952:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0e83faa400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f0e83f66c00 00010000:00010000:0.0:1789683514.987001:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a04d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987013:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a04d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987022:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a04d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987028:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683514.987032:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a04d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987040:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a04d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987071:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f0fc11eb300) 00010000:00010000:0.0:1789683514.987074:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683514.987080:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a04d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987086:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a04d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987106:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a054 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987112:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a054 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987118:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a054 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987123:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683514.987125:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a054 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987131:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a054 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987137:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:0.0:1789683514.987139:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683514.987141:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a054 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987147:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a054 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987183:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a093 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987189:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a093 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987195:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a093 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987200:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683514.987203:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a093 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987209:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a093 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987217:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0e835a6a00) 00010000:00010000:0.0:1789683514.987219:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683514.987222:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a093 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987227:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a093 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987243:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a196 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987249:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a196 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987254:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a196 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987265:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683514.987268:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a196 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987274:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a196 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987282:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:0.0:1789683514.987284:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683514.987287:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a196 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987293:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a196 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987305:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a1b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987311:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a1b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987316:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a1b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987321:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837daa00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683514.987324:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a1b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987330:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a1b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987347:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:0.0:1789683514.987349:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683514.987352:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a1b9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987358:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a1b9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987370:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a1ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987375:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a1ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987381:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a1ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987386:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dbc00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683514.987388:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a1ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987394:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a1ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987401:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:0.0:1789683514.987403:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683514.987405:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a1ff lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683514.987411:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a1ff lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789683514.987689:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789683514.987751:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789683514.987759:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683514.987775:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc070ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850224256:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789683514.987860:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683514.987918:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850224256 00000100:00100000:2.0:1789683514.987926:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850224256 00000100:00100000:2.0:1789683514.987974:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789683514.987984:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876618850224256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789683514.988014:0:8439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1789683514.988050:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aac6738, atime: 0x6aac6738, ctime: 0x6aac6738, blocks: 0x8 00010000:00010000:2.0:1789683514.988058:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a6187bb/0xcf8485587b88a2a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.988072:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=429s v=(0 0) 00010000:00010000:2.0:1789683514.988077:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683514.988083:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a6187bb/0xcf8485587b88a2a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.988097:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a6187bb/0xcf8485587b88a2a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.988119:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a6187bb/0xcf8485587b88a2a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.988126:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a6187bb/0xcf8485587b88a2a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.988142:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789683514.988281:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3647:x1876618850224256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 297us (420us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789683514.988288:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:2.0:1789683514.988309:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683514.988315:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a6187bb/0xcf8485587b88a2a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.988323:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683514.988326:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a6187bb/0xcf8485587b88a2a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.988334:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a6187bb/0xcf8485587b88a2a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.988347:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a6187bb/0xcf8485587b88a2a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.988355:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a6187bb/0xcf8485587b88a2a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683514.988377:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683514.988379:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683514.988381:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789683514.988410:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0fc070ad80/2, rc 0, transno 4294967308 00000100:00100000:2.0:1789683514.988415:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc070ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850224256:0@lo:6:osp-syn-1-0.0 00000040:00080000:0.0:1789683515.039059:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789683515.039070:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789683515.039110:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789683515.039119:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789683515.039257:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1876618850224384:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789683515.039357:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e929c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683515.041526:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1876618850224384:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789683515.054586:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683515.054672:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835480192 00000100:00100000:0.0:1789683515.054682:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835480192 00000100:00100000:0.0:1789683515.054764:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 185 00000100:00100000:0.0:1789683515.054775:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+17:12367:x1876618835480192:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789683515.054837:0:8462:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789683515.054973:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+17:12367:x1876618835480192:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 200us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683515.054981:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 185 00000100:00080000:3.0:1789683515.055374:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683515.061396:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683515.061808:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835480320 00000100:00100000:2.0:1789683515.061819:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835480320 00000100:00100000:2.0:1789683515.061866:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 186 00000100:00100000:2.0:1789683515.061887:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc14ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+17:12367:x1876618835480320:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789683515.061967:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a2ae lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.061984:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a2ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.061996:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a2ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062012:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a2b5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062019:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062025:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062051:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a2bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062075:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a2bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062081:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a2bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683515.062129:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789683515.062133:0:12533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683515.062144:0:12533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a2bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062154:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a2ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062409:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a2ae lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062416:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a2ae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062423:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683515.062427:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a2ae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062435:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a2ae lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062447:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0f854c2c00) 00010000:00010000:2.0:1789683515.062459:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683515.062465:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a2ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062483:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a2ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062497:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062503:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a2b5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062508:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062513:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683515.062516:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062521:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a2b5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062527:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9f0f85396a00) 00010000:00010000:2.0:1789683515.062529:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683515.062532:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a2b5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062536:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a2b5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062549:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a2bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062555:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a2bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062565:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a2bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062570:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683515.062573:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a2bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062578:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a2bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062585:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:2.0:1789683515.062586:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683515.062589:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a2bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.062594:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a2bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683515.062702:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc14ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+17:12367:x1876618835480320:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 Request processed in 825us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683515.062709:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 186 00000100:00100000:3.0:1789683515.072004:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683515.072050:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835480576 00000100:00100000:3.0:1789683515.072062:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835480576 00000100:00100000:3.0:1789683515.072128:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 187 00000100:00100000:3.0:1789683515.072141:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+17:12367:x1876618835480576:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683515.072177:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683515.072199:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a2c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc7c1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.072443:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a2ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.072459:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a2ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.072489:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a2ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683515.072504:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789683515.072609:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a2ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.072618:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a2ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.072626:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a2ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.072632:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683515.072636:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a2ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.072643:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a2ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.072657:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:3.0:1789683515.072660:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789683515.072665:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a2ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.072672:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a2ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.072719:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a2c3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7c1 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.072743:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0f854c2c00) 00010000:00010000:3.0:1789683515.072745:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683515.072750:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a2c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7c1 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.072760:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176800, rc 0) 00000100:00100000:3.0:1789683515.072858:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+18:12367:x1876618835480576:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 720us (865us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1789683515.072865:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 187 00000100:00100000:3.0:1789683515.075693:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683515.080038:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835480704 00000100:00100000:1.0:1789683515.080059:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835480704 00000100:00100000:1.0:1789683515.080173:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 188 00000100:00100000:1.0:1789683515.080190:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+18:12367:x1876618835480704:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789683515.080226:0:6522:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789683515.080363:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+18:12367:x1876618835480704:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 174us (4681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683515.080371:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 188 00000100:00100000:0.0:1789683515.091387:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683515.091637:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835480960 00000100:00100000:3.0:1789683515.091649:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835480960 00000100:00100000:3.0:1789683515.091716:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 189 00000100:00100000:3.0:1789683515.091727:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+18:12367:x1876618835480960:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683515.091753:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683515.091756:0:12533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789683515.091813:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a27d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7b3 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.091832:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:3.0:1789683515.091837:0:12533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683515.091851:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a2d8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc7c8 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789683515.092462:0:12533:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789683515.092620:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88a2df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.092634:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88a2df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.092645:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88a2df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.092697:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a2d8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7c8 expref: 20 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.092714:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88a2df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7c8 expref: 19 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.092721:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0e81d1f000) 00010000:00010000:3.0:1789683515.092724:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683515.092727:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176200, rc 0) 00000100:00100000:3.0:1789683515.092819:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+19:12367:x1876618835480960:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 1093us (1442us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789683515.092827:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 189 00000100:00100000:0.0:1789683515.107593:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683515.107689:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835481216 00000100:00100000:1.0:1789683515.107701:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835481216 00000100:00100000:1.0:1789683515.107768:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 190 00000100:00100000:1.0:1789683515.107780:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+19:12367:x1876618835481216:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789683515.107862:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683515.107901:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88a2df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7c8 expref: 19 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.107919:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0e81d1f000) 00010000:00010000:1.0:1789683515.107931:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789683515.107959:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a2ed lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.107976:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a2ed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.107987:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a2ed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.108003:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a2f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xda04668a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.108011:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xda04668a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.108030:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xda04668a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.108081:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a2ed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.108088:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a2ed lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.108094:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a2ed lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.108101:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81391a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683515.108106:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a2ed lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.108114:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a2ed lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.108123:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:1.0:1789683515.108126:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683515.108130:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a2ed lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.108136:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a2ed lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.108146:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xda04668a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.108152:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a2f4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xda04668a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.108178:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a2f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xda04668a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.108183:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81391400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683515.108186:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a2f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xda04668a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.108192:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a2f4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xda04668a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.108201:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xda04668a (ffff9f0fb8504600) 00010000:00010000:1.0:1789683515.108212:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683515.108216:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a2f4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xda04668a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.108222:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a2f4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xda04668a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683515.108305:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+18:12367:x1876618835481216:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 527us (723us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789683515.108312:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 190 00000100:00100000:0.0:1789683515.114812:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683515.114861:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835481344 00000100:00100000:0.0:1789683515.114872:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835481344 00000100:00100000:0.0:1789683515.114928:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 191 00000100:00100000:0.0:1789683515.114938:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+18:12367:x1876618835481344:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683515.114960:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683515.114981:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a2fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc7cf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.115032:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a302 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.115047:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a302 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.115061:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a302 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.115183:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a2fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7cf expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.115200:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a302 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7cf expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.115221:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0e835a6a00) 00010000:00010000:0.0:1789683515.115225:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789683515.115229:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454de00, rc 0) 00000100:00100000:0.0:1789683515.115293:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+19:12367:x1876618835481344:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 356us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683515.115302:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 191 00000100:00100000:3.0:1789683515.133899:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683515.133936:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835481600 00000100:00100000:3.0:1789683515.133945:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835481600 00000100:00100000:3.0:1789683515.133995:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 192 00000100:00100000:3.0:1789683515.134005:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+19:12367:x1876618835481600:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789683515.134090:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a309 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.134120:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a309 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.134130:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a309 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789683515.134302:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1789683515.134311:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 429183526885ns, next at 430183524325ns, rc = 0 00000004:00010000:3.0:1789683515.134354:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a18de26a reply state 00000000079a6b86 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a309 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.134365:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a309 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.134371:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0e835a6a00) 00010000:00010000:3.0:1789683515.134374:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789683515.134378:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789683515.134465:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+21:12367:x1876618835481600:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 460us (575us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789683515.134472:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 192 00000100:00100000:0.0:1789683515.143139:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683515.143187:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835481728 00000100:00100000:0.0:1789683515.143199:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835481728 00000100:00100000:0.0:1789683515.143278:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 193 00000100:00100000:0.0:1789683515.143288:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+21:12367:x1876618835481728:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683515.143314:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683515.143362:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a310 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc7d6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.143423:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a310 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7d6 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.143439:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a310 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7d6 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.143458:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0e835a6a00) 00010000:00010000:0.0:1789683515.143462:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789683515.143465:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454c600, rc 0) 00000100:00100000:0.0:1789683515.143529:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+22:12367:x1876618835481728:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 242us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683515.143536:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 193 00000100:00100000:0.0:1789683515.153398:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683515.154141:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835481856 00000100:00100000:1.0:1789683515.154153:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835481856 00000100:00100000:1.0:1789683515.154257:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:1.0:1789683515.154270:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f85250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec036ece-1720-411a-849c-c978dbb41f8a+6:2405:x1876618835481856:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789683515.154513:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f85250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec036ece-1720-411a-849c-c978dbb41f8a+7:2405:x1876618835481856:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 246us (1124us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789683515.154522:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00080000:0.0:1789683515.155842:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683515.165315:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683515.165460:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835482112 00000100:00100000:3.0:1789683515.165471:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835482112 00000100:00100000:3.0:1789683515.165533:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 49 00000100:00100000:3.0:1789683515.165546:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+22:12367:x1876618835482112:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789683515.165809:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+23:12367:x1876618835482112:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 265us (503us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1789683515.165816:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 49 00000100:00100000:1.0:1789683515.168619:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683515.168766:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835482368 00000100:00100000:3.0:1789683515.168826:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835482368 00000100:00100000:3.0:1789683515.168896:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 194 00000100:00100000:3.0:1789683515.168907:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+23:12367:x1876618835482368:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789683515.169029:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+23:12367:x1876618835482368:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 124us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683515.169037:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 194 00000100:00100000:1.0:1789683515.172971:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683515.173100:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835482496 00000100:00100000:3.0:1789683515.173116:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835482496 00000100:00100000:3.0:1789683515.173189:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 195 00000100:00100000:3.0:1789683515.173199:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+23:12367:x1876618835482496:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683515.173223:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683515.173246:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a317 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc7dd expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.173325:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a31e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.173352:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a31e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.173365:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a31e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683515.173414:0:12533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789683515.173434:0:12533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a31e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.173472:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a317 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7dd expref: 25 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.173512:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a31e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7dd expref: 24 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.173521:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0e835a6a00) 00010000:00010000:3.0:1789683515.173524:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789683515.173528:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6177000, rc 0) 00000100:00100000:3.0:1789683515.173600:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+24:12367:x1876618835482496:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 403us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683515.173607:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 195 00000100:00100000:0.0:1789683515.177837:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683515.177949:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835482624 00000100:00100000:2.0:1789683515.177961:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835482624 00000100:00100000:2.0:1789683515.178016:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:2.0:1789683515.178025:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+7:2402:x1876618835482624:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683515.178046:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683515.178069:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f519eb4/0xcf8485587b88a325 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc7e4 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789683515.178115:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac673b, blocks: 0x0 00010000:00010000:2.0:1789683515.178136:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=429s v=(0 0) 00010000:00010000:2.0:1789683515.178140:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683515.178148:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f519eb4/0xcf8485587b88a325 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7e4 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.178179:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001f519eb4/0xcf8485587b88a325 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7e4 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.178192:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31200, rc 0) 00000100:00100000:2.0:1789683515.178243:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+8:2402:x1876618835482624:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 218us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683515.178250:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:1.0:1789683515.181382:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683515.181470:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835482880 00000100:00100000:0.0:1789683515.181482:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835482880 00000100:00100000:0.0:1789683515.181540:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 196 00000100:00100000:0.0:1789683515.181550:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+24:12367:x1876618835482880:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789683515.181655:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+24:12367:x1876618835482880:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 106us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683515.181661:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 196 00000100:00100000:1.0:1789683515.184772:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683515.185320:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835483008 00000100:00100000:2.0:1789683515.185332:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835483008 00000100:00100000:2.0:1789683515.185491:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 62 00000100:00100000:2.0:1789683515.185503:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+8:12367:x1876618835483008:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683515.185523:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683515.185543:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b88a32c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc7eb expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.185577:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f519eb4/0xcf8485587b88a325 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7e4 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.185607:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683515.185611:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683515.185618:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b88a32c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7eb expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.185653:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f519eb4/0xcf8485587b88a325 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7e4 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.185667:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f519eb4/0xcf8485587b88a325 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7e4 expref: 9 pid: 8437 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683515.185681:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1876618850224512:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683515.185779:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c22ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683515.188061:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1876618850224512:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683515.188093:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b88a32c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7eb expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.188113:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30600, rc 0) 00000100:00100000:2.0:1789683515.188187:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+9:12367:x1876618835483008:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 2686us (3425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683515.188197:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 62 00000100:00100000:0.0:1789683515.190326:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683515.190439:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835483136 00000100:00100000:3.0:1789683515.190461:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835483136 00010000:00010000:3.0:1789683515.190504:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f519eb4/0xcf8485587b88a325 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7e4 expref: 9 pid: 8437 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683515.190551:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 88 00000100:00100000:3.0:1789683515.190562:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84414e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+9:2402:x1876618835483136:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683515.190581:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683515.190603:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f519eb4/0xcf8485587b88a325 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7e4 expref: 9 pid: 8437 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.190619:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f519eb4/0xcf8485587b88a325 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7e4 expref: 9 pid: 8437 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.190643:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f519eb4/0xcf8485587b88a325 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7e4 expref: 9 pid: 8437 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.190671:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683515.190675:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683515.190685:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b88a32c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7eb expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.190696:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b88a32c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7eb expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.190739:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b88a32c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7eb expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683515.190756:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6506:1876618850224640:192.168.201.50@tcp:105: 00000100:00100000:3.0:1789683515.190892:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f98fc3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683515.194747:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683515.194885:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835483264 00000100:00100000:1.0:1789683515.194894:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835483264 00002000:00100000:1.0:1789683515.194944:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9f0e84415f80 x1876618835483264/t0(0) o4->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:571/0 lens 504/0 e 0 to 0 dl 1789683526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789683515.194955:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e84415f80 with x1876618835483264 ext(0->8) 00002000:00010000:1.0:1789683515.194961:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0e84415f80 00000100:00100000:1.0:1789683515.194995:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:1.0:1789683515.195005:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec036ece-1720-411a-849c-c978dbb41f8a+9:2403:x1876618835483264:12345-192.168.201.50@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789683515.195563:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6506:1876618850224640:192.168.201.50@tcp:105: 00010000:00010000:3.0:1789683515.195587:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683515.195636:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84414e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+11:2402:x1876618835483136:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 5076us (5324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683515.195643:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 88 00000100:00100000:1.0:1789683515.196514:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec036ece-1720-411a-849c-c978dbb41f8a+10:2403:x1876618835483264:12345-192.168.201.50@tcp:4:lhsmtool_posix.0 Request processed in 1506us (1771us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789683515.196524:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 5 00002000:00100000:1.0:1789683515.196533:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9f0e84415f80 x1876618835483264/t4294967316(0) o4->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:571/0 lens 504/448 e 0 to 0 dl 1789683526 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789683515.196543:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e84415f80 with x1876618835483264 ext(0->8) 00002000:00010000:1.0:1789683515.196547:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0e84415f80 00000100:00100000:0.0:1789683515.203668:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683515.203835:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835483392 00000100:00100000:1.0:1789683515.203846:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835483392 00000100:00100000:1.0:1789683515.203917:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 197 00000100:00100000:1.0:1789683515.203929:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+24:12367:x1876618835483392:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789683515.205659:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1789683515.205673:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1789683515.205687:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1789683515.205745:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1789683515.205758:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:3.0:1789683515.205821:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a309 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.205834:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a309 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.205842:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a309 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.205858:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683515.205862:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a309 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.205879:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a309 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.205900:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0e835a6a00) 00010000:00010000:3.0:1789683515.205903:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789683515.205908:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a309 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.205915:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a309 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683515.206182:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+19:12367:x1876618835483392:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 Request processed in 2251us (2517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683515.206192:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 197 00000100:00100000:1.0:1789683515.206431:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683515.206446:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850224768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789683515.206505:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683515.206546:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850224768 00000100:00100000:1.0:1789683515.206552:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850224768 00000100:00100000:1.0:1789683515.206588:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789683515.206595:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850224768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789683515.206709:0:14000:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789683515.206713:0:14000:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789683515 00002000:00010000:1.0:1789683515.206715:0:14000:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789683515.206717:0:14000:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789683515 -> 1789683515 00002000:00010000:1.0:1789683515.206719:0:14000:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789683515.206750:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3650:x1876618850224768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 156us (245us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789683515.206756:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:1.0:1789683515.206817:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0fb7a24380/2, rc 0, transno 4294967317 00000100:00100000:1.0:1789683515.206822:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850224768:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789683515.209939:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683515.210024:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835483520 00000100:00100000:2.0:1789683515.210048:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835483520 00000100:00100000:2.0:1789683515.210105:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:2.0:1789683515.210116:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+10:2404:x1876618835483520:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789683515.213594:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:0.0:1789683515.213615:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000100:00100000:2.0:1789683515.213980:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:2404:x1876618835483520:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 Request processed in 3858us (4044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683515.213992:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:0.0:1789683515.216422:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683515.216608:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835483776 00000100:00100000:2.0:1789683515.216619:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835483776 00000100:00100000:2.0:1789683515.216676:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 198 00000100:00100000:2.0:1789683515.216687:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+19:12367:x1876618835483776:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789683515.216741:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683515.216771:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88a31e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7dd expref: 19 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.216829:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0e835a6a00) 00010000:00010000:2.0:1789683515.216835:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683515.216864:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a333 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.216889:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a333 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.216900:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a333 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683515.217042:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000433ca84c reply state 0000000014550fa6 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a333 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.217055:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a333 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.217077:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0e835a6a00) 00010000:00010000:2.0:1789683515.217080:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789683515.217083:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683515.217299:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+20:12367:x1876618835483776:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 612us (887us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1789683515.217306:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 198 00000100:00100000:0.0:1789683515.220197:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683515.220297:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835483904 00000100:00100000:2.0:1789683515.220307:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835483904 00000100:00100000:2.0:1789683515.220370:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:2.0:1789683515.220379:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+7:2403:x1876618835483904:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789683515.220516:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789683515.220519:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789683515 -> 1789683514 00002000:00010000:2.0:1789683515.220521:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789683512 00002000:00010000:2.0:1789683515.220522:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789683515 -> 1789683514 00002000:00010000:2.0:1789683515.220524:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789683515.220567:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+8:2403:x1876618835483904:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 190us (378us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789683515.220572:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:1.0:1789683515.224678:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683515.224806:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835484160 00000100:00100000:3.0:1789683515.224814:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835484160 00000100:00100000:3.0:1789683515.224889:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 199 00000100:00100000:3.0:1789683515.224899:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+20:12367:x1876618835484160:12345-192.168.201.50@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789683515.224968:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a33a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.224985:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a302 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7cf expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.225013:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a33a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.225043:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a302 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7cf expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.225054:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a302 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7cf expref: 20 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683515.225067:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850224896:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789683515.225147:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f98fc3840 going to sleep for 11 seconds 00000100:00100000:3.0:1789683515.227325:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850224896:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789683515.227367:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a33a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683515.228653:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683515.228731:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835484288 00000100:00100000:3.0:1789683515.228741:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835484288 00010000:00010000:3.0:1789683515.228825:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a302 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7cf expref: 21 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683515.228865:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 89 00000100:00100000:3.0:1789683515.228883:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84446050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+21:2402:x1876618835484288:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683515.228899:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683515.228906:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a302 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7cf expref: 21 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.228940:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a302 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7cf expref: 21 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.228963:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a302 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7cf expref: 21 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.228982:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0e835a6a00) 00010000:00010000:3.0:1789683515.228987:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a33a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.228999:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a33a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.229006:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a33a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.229027:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683515.229085:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84446050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+20:2402:x1876618835484288:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 212us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683515.229093:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 89 00010000:00010000:0.0:1789683515.229257:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a33a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.229267:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a33a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.229315:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a33a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.229322:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a33a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.229329:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a33a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.229340:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683515.229345:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a33a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.229352:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a33a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.229362:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0e835a6a00) 00010000:00010000:0.0:1789683515.229373:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789683515.229378:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a33a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.229384:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177c00/0xcf8485587b88a33a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683515.229428:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+19:12367:x1876618835484160:12345-192.168.201.50@tcp:55:lhsmtool_posix.0 Request processed in 4530us (4758us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789683515.229436:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 199 00000100:00100000:0.0:1789683515.232831:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683515.232951:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835484416 00000100:00100000:2.0:1789683515.232961:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835484416 00000100:00100000:2.0:1789683515.233012:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 66 00000100:00100000:2.0:1789683515.233023:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+8:2402:x1876618835484416:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789683515.233071:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000464b9ae4/0xcf8485587b88a341 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.233090:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b88a32c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7eb expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.233111:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683515.233116:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789683515.233121:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000464b9ae4/0xcf8485587b88a341 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.233154:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b88a32c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7eb expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.233181:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b88a32c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7eb expref: 8 pid: 8440 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683515.233195:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8437:1876618850225024:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683515.233285:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c22a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789683515.237509:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683515.237672:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8437:1876618850225024:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683515.237700:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000464b9ae4/0xcf8485587b88a341 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683515.237932:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835484544 00000100:00100000:0.0:1789683515.237941:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835484544 00010000:00010000:0.0:1789683515.237979:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b88a32c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7eb expref: 9 pid: 8440 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683515.238017:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 90 00000100:00100000:0.0:1789683515.238026:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+9:2403:x1876618835484544:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683515.238043:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683515.238067:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b88a32c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7eb expref: 9 pid: 8440 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.238081:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b88a32c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7eb expref: 9 pid: 8440 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.238107:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf267c48/0xcf8485587b88a32c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7eb expref: 9 pid: 8440 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.238146:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789683515.238151:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789683515.238157:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000464b9ae4/0xcf8485587b88a341 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.238167:0:10343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000464b9ae4/0xcf8485587b88a341 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683515.238198:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683515.238221:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000464b9ae4/0xcf8485587b88a341 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.238230:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000464b9ae4/0xcf8485587b88a341 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.238250:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000464b9ae4/0xcf8485587b88a341 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.238264:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000464b9ae4/0xcf8485587b88a341 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683515.238269:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+8:2403:x1876618835484544:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 244us (769us total) trans 0 rc 0/0 00010000:00010000:2.0:1789683515.238273:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000464b9ae4/0xcf8485587b88a341 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683515.238277:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 90 00010000:00010000:2.0:1789683515.238280:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683515.238284:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000464b9ae4/0xcf8485587b88a341 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.238293:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000464b9ae4/0xcf8485587b88a341 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.238305:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000464b9ae4/0xcf8485587b88a341 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.238312:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000464b9ae4/0xcf8485587b88a341 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683515.238366:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+7:2402:x1876618835484416:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 Request processed in 5345us (5584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683515.238373:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 66 00000100:00100000:3.0:1789683515.240505:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683515.240642:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835484800 00000100:00100000:1.0:1789683515.240650:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835484800 00000100:00100000:1.0:1789683515.240698:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 200 00000100:00100000:1.0:1789683515.240705:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+19:12367:x1876618835484800:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789683515.240773:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a348 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.240820:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a18f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc774 expref: 19 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.240848:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a348 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.240890:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a18f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc774 expref: 19 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.240905:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a18f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc774 expref: 19 pid: 8462 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683515.240919:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1876618850225152:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789683515.240997:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa3480 going to sleep for 11 seconds 00000100:00100000:1.0:1789683515.246322:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683515.246567:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1876618850225152:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789683515.246594:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a348 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683515.246742:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835484928 00000100:00100000:2.0:1789683515.246750:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835484928 00010000:00010000:2.0:1789683515.247001:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a18f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc774 expref: 20 pid: 8462 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683515.247090:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 91 00000100:00100000:2.0:1789683515.247101:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+20:2403:x1876618835484928:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683515.247118:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683515.247125:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a18f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc774 expref: 20 pid: 8462 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.247137:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a18f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc774 expref: 20 pid: 8462 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.247166:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177200/0xcf8485587b88a18f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc774 expref: 20 pid: 8462 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.247178:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:2.0:1789683515.247182:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a348 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.247190:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.247196:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a348 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.247219:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683515.247277:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+19:2403:x1876618835484928:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 178us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683515.247285:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 91 00010000:00010000:3.0:1789683515.247343:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.247361:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.247538:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a34f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.247550:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a310 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7d6 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.247558:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a34f lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.247584:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a310 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7d6 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.247596:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a310 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7d6 expref: 19 pid: 6523 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683515.247610:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8445d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1876618850225280:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789683515.247653:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f98fc3480 going to sleep for 11 seconds 00000100:00100000:0.0:1789683515.251086:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683515.251261:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835485056 00000100:00100000:3.0:1789683515.251264:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8445d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1876618850225280:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789683515.251270:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835485056 00010000:00010000:3.0:1789683515.251293:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a34f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.251310:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a310 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7d6 expref: 20 pid: 6523 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683515.251348:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 92 00000100:00100000:1.0:1789683515.251357:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84415500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+20:2403:x1876618835485056:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683515.251372:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683515.251379:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a310 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7d6 expref: 20 pid: 6523 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.251392:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a310 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7d6 expref: 20 pid: 6523 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.251434:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a310 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7d6 expref: 20 pid: 6523 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.251445:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0e835a6a00) 00010000:00010000:1.0:1789683515.251449:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a34f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.251458:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a34f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.251465:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a34f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.251493:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683515.251523:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a34f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.251530:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a34f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683515.251552:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84415500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+19:2403:x1876618835485056:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 196us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683515.251560:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 92 00000001:00080000:3.0:1789683515.251646:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1789683515.251755:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1789683515.251815:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1789683515.253364:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cac380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8462:1876618850225408:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789683515.253442:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683515.253471:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c22a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683515.253544:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850225408 00000100:00100000:3.0:1789683515.253551:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850225408 00000100:00100000:3.0:1789683515.253639:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789683515.253649:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8462:x1876618850225408:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789683515.253750:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8462:x1876618850225408:12345-0@lo:1000:mdt00_003.0 Request processed in 102us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683515.253758:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789683515.253779:0:8462:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:2.0:1789683515.253818:0:8462:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0fb7a24380, transno 4294967317 00000100:00100000:2.0:1789683515.253833:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cac380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8462:1876618850225408:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789683515.253974:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1789683515.254015:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cac380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8462:1876618850225536:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789683515.254036:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683515.254382:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850225536 00000100:00100000:3.0:1789683515.254387:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850225536 00000100:00100000:2.0:1789683515.254389:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c22a180 going to sleep for 11 seconds 00000100:00100000:3.0:1789683515.254421:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789683515.254430:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8462:x1876618850225536:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789683515.254535:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8462:x1876618850225536:12345-0@lo:1000:mdt00_003.0 Request processed in 106us (497us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1789683515.254542:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789683515.254575:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cac380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8462:1876618850225536:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789683515.254613:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a34f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.254624:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a34f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.254632:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a34f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.254638:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683515.254642:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a34f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.254650:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a34f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.254665:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0e835a6a00) 00010000:00010000:2.0:1789683515.254668:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683515.254674:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a34f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.254692:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176800/0xcf8485587b88a34f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.254721:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a284 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.254728:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a284 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.254734:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a284 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.254739:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683515.254742:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a284 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.254748:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a284 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.254756:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:2.0:1789683515.254758:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683515.254762:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a284 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.254767:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176a00/0xcf8485587b88a284 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.254897:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a356 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.254912:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a2a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7ba expref: 22 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.254926:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a356 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.254952:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7ba expref: 22 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.254961:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a2a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7ba expref: 22 pid: 12533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683515.254970:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e836a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1876618850225664:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683515.255028:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c22a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789683515.257078:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e836a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8462:1876618850225664:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683515.257108:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a356 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683515.258354:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683515.258581:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835485184 00000100:00100000:1.0:1789683515.258590:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835485184 00010000:00010000:1.0:1789683515.258629:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a2a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7ba expref: 23 pid: 12533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683515.258670:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 93 00000100:00100000:1.0:1789683515.258678:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84414e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+23:2403:x1876618835485184:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683515.258691:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683515.258695:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a2a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7ba expref: 23 pid: 12533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.258720:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7ba expref: 23 pid: 12533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.258738:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a2a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7ba expref: 23 pid: 12533 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.258751:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:1.0:1789683515.258756:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a356 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.258765:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a356 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.258771:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a356 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683515.258824:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683515.258837:0:8462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a356 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.258846:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a356 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.258858:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a356 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.258865:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a356 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683515.258886:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84414e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+22:2403:x1876618835485184:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 208us (539us total) trans 0 rc 0/0 00010000:00010000:3.0:1789683515.258891:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a356 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683515.258893:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 93 00010000:00010000:3.0:1789683515.258898:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683515.258902:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a356 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.258909:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a356 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.258918:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:3.0:1789683515.258921:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683515.258924:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a356 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.258931:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a356 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.258943:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.258948:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a348 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.258954:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a348 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.258960:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81391a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683515.258963:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a348 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.258979:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a348 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.258988:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:3.0:1789683515.258990:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789683515.258994:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a348 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.259000:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a348 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683515.259163:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+21:12367:x1876618835484800:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 18457us (18661us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789683515.259171:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 200 00000020:00080000:3.0:1789683515.259175:0:8462:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789683515.259618:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683515.259624:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683515.260144:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1789683515.260155:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789683515.263354:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683515.263456:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835485440 00000100:00100000:2.0:1789683515.263467:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835485440 00000100:00100000:2.0:1789683515.263538:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:2.0:1789683515.263549:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f867c9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+21:12367:x1876618835485440:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789683515.263856:0:6525:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789683515.263902:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1789683515.263940:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a35d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.263959:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a35d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.263993:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a35d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.264003:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a35d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.264009:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a35d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.264014:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a35d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683515.264030:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683515.264051:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683515.264057:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a35d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.264063:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31a00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683515.264067:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a35d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.264074:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a35d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.264085:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0e835a6a00) 00010000:00010000:3.0:1789683515.264088:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789683515.264098:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a35d lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.264104:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a35d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683515.264115:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683515.264116:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f867c9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+23:12367:x1876618835485440:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 568us (789us total) trans 4294967470 rc 0/0 00010000:00010000:3.0:1789683515.264117:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683515.264119:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683515.264124:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 50 00000020:00080000:2.0:1789683515.264129:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789683515.423891:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683516.448254:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789683516.828531:0:14766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789683516.828543:0:14766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789683516.828561:0:14766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789683516.828567:0:14766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789683516.953168:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683516.953216:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683516.953248:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683516.953271:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683516.953355:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835485696 00000100:00100000:1.0:1789683516.953366:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835485696 00000100:00100000:1.0:1789683516.953411:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835486208 00000100:00100000:1.0:1789683516.953423:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835486208 00000100:00100000:1.0:1789683516.953466:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 329 00000100:00100000:1.0:1789683516.953476:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+23:2405:x1876618835485696:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683516.953557:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+23:2405:x1876618835485696:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 81us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683516.953564:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 329 00000100:00100000:1.0:1789683516.953586:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 330 00000100:00100000:1.0:1789683516.953592:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835486208:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683516.953618:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835486208:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 26us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683516.953623:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 330 00000100:00080000:1.0:1789683516.953639:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683516.953987:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683516.954023:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683516.954045:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683516.954086:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683516.954103:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835485824 00000100:00100000:0.0:1789683516.954107:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835485824 00000100:00100000:0.0:1789683516.954129:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835486336 00000100:00100000:0.0:1789683516.954131:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835486336 00000100:00100000:0.0:1789683516.954144:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835486592 00000100:00100000:0.0:1789683516.954146:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835486592 00000100:00100000:0.0:1789683516.954159:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 331 00000100:00100000:0.0:1789683516.954166:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835485824:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683516.954199:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835485824:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 33us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683516.954206:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 331 00000100:00100000:0.0:1789683516.954219:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 332 00000100:00100000:0.0:1789683516.954225:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835486336:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683516.954249:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835486336:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683516.954256:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 332 00000100:00100000:0.0:1789683516.954267:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 201 00000100:00100000:0.0:1789683516.954273:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+23:12384:x1876618835486592:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789683516.954283:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683516.954313:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b88a364 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc7f2 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683516.954414:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a36b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683516.954429:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a36b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683516.954500:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a36b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683516.954513:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789683516.954618:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b88a364 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7f2 expref: 26 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683516.954633:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a36b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7f2 expref: 25 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683516.954642:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:0.0:1789683516.954645:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789683516.954649:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d400, rc 0) 00000100:00100000:0.0:1789683516.954670:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+25:12384:x1876618835486592:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 398us (583us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1789683516.954676:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 201 00000100:00080000:1.0:1789683516.954857:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789683516.954949:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835485952 00000100:00100000:0.0:1789683516.954954:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835485952 00000100:00100000:0.0:1789683516.954976:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835486080 00000100:00100000:0.0:1789683516.954978:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835486080 00000100:00100000:0.0:1789683516.954998:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 130 00000100:00100000:0.0:1789683516.955005:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:2405:x1876618835485952:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683516.955037:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:2405:x1876618835485952:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 33us (1789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683516.955043:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 130 00000100:00100000:0.0:1789683516.955055:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 131 00000100:00100000:0.0:1789683516.955061:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:2405:x1876618835486080:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683516.955092:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:2405:x1876618835486080:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 31us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683516.955099:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 131 00000100:00100000:3.0:1789683516.955361:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835485568 00000100:00100000:3.0:1789683516.955366:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835485568 00000100:00100000:3.0:1789683516.955450:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 395 00000100:00100000:3.0:1789683516.955458:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:2402:x1876618835485568:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683516.955484:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:2402:x1876618835485568:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 28us (2328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683516.955490:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 395 00000100:00080000:1.0:1789683516.955567:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683516.958210:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683516.958281:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835486720 00000100:00100000:2.0:1789683516.958289:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835486720 00000100:00100000:2.0:1789683516.958345:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 202 00000100:00100000:2.0:1789683516.958354:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+25:12384:x1876618835486720:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:2.0:1789683516.958416:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a379 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958432:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a379 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958444:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a379 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958469:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a380 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958477:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958483:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958552:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a387 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958559:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958565:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683516.958609:0:12533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958620:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a379 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958627:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a379 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958634:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a379 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958640:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683516.958643:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a379 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958656:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a379 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958667:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:2.0:1789683516.958670:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683516.958675:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a379 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958681:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a379 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958691:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958697:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a380 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958703:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a380 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958708:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683516.958710:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a380 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958715:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a380 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958721:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0f85396a00) 00010000:00010000:2.0:1789683516.958723:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683516.958726:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a380 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958749:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a380 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958761:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958767:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a387 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958773:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a387 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958777:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683516.958811:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a387 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958817:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a387 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958824:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0f85396600) 00010000:00010000:2.0:1789683516.958827:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683516.958830:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a387 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683516.958836:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a387 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683516.958919:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+25:12384:x1876618835486720:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 566us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683516.958927:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 202 00000100:00100000:0.0:1789683517.017487:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683517.017913:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835486976 00000100:00100000:1.0:1789683517.017924:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835486976 00000100:00100000:1.0:1789683517.017996:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 203 00000100:00100000:1.0:1789683517.018007:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+25:12387:x1876618835486976:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789683517.018032:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683517.018053:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a38e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc7f9 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789683517.018404:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789683517.018476:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a395 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018493:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a395 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018525:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a395 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018546:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a39c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018555:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a39c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018562:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a39c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018695:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a3a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018704:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018711:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683517.018724:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789683517.018871:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a395 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018878:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a395 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018886:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a395 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018892:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81391a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683517.018902:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a395 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018911:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a395 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018923:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:1.0:1789683517.018926:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683517.018931:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a395 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018938:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a395 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018952:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a39c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018958:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a39c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018963:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a39c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018968:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dbc00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683517.018971:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a39c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018976:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a39c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018982:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0fb8504600) 00010000:00010000:1.0:1789683517.018984:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683517.018993:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a39c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.018998:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a39c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.019042:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a38e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7f9 expref: 28 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.019057:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7f9 expref: 27 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.019064:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504a00) 00010000:00010000:1.0:1789683517.019067:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683517.019069:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837daa00, rc 0) 00000100:00100000:1.0:1789683517.021583:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+27:12387:x1876618835486976:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 3567us (4094us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789683517.021592:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 203 00000100:00100000:1.0:1789683517.028342:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850225792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683517.028402:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683517.028457:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850225792 00000100:00100000:1.0:1789683517.028464:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850225792 00000100:00100000:1.0:1789683517.028500:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789683517.028506:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850225792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683517.028537:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789683517.028569:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850225792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683517.028573:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789683517.028624:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850225792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683517.029967:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683517.030017:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835487104 00000100:00100000:0.0:1789683517.030023:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835487104 00000100:00100000:0.0:1789683517.030062:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 204 00000100:00100000:0.0:1789683517.030069:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+27:12387:x1876618835487104:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:0.0:1789683517.030119:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.030381:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.030395:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.030435:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.030442:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.030450:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.030457:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454cc00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683517.030462:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.030483:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.030495:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504a00) 00010000:00010000:0.0:1789683517.030498:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789683517.030504:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.030510:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683517.030590:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+27:12387:x1876618835487104:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 519us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683517.030598:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 204 00000100:00100000:1.0:1789683517.033584:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683517.033825:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835487360 00000100:00100000:3.0:1789683517.033851:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835487360 00000100:00100000:3.0:1789683517.033909:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 51 00000100:00100000:3.0:1789683517.033920:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+27:12387:x1876618835487360:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789683517.034185:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+28:12387:x1876618835487360:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 266us (612us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1789683517.034193:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 51 00000100:00100000:1.0:1789683517.068965:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683517.069067:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835487616 00000100:00100000:0.0:1789683517.069078:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835487616 00000100:00100000:0.0:1789683517.069146:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 205 00000100:00100000:0.0:1789683517.069156:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+28:11911:x1876618835487616:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789683517.069187:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683517.069211:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3b8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc800 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.069432:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88a3bf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.069449:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7f9 expref: 29 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.069459:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88a3bf lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.069509:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7f9 expref: 29 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.069525:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a3a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7f9 expref: 29 pid: 8462 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683517.069540:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f18700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850225920:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789683517.069635:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683517.073271:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683517.073381:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835487744 00000100:00100000:1.0:1789683517.073391:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835487744 00010000:00010000:1.0:1789683517.073436:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a3a3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7f9 expref: 30 pid: 8462 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683517.073476:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 94 00000100:00100000:1.0:1789683517.073486:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8445d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+30:2403:x1876618835487744:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683517.073504:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683517.073512:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a3a3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7f9 expref: 30 pid: 8462 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.073526:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a3a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7f9 expref: 30 pid: 8462 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.073548:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504a00) 00010000:00010000:1.0:1789683517.073555:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88a3bf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.073565:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88a3bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.073573:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88a3bf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.073591:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683517.073659:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8445d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+30:2403:x1876618835487744:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 174us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683517.073665:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 94 00010000:00010000:0.0:1789683517.073774:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a3a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7f9 expref: 29 pid: 8462 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683517.073818:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f18700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850225920:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683517.073856:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88a3bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.073866:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88a3bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.073872:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88a3bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683517.073892:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789683517.074016:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3b8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc800 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.074027:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88a3bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc800 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.074040:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504a00) 00010000:00010000:0.0:1789683517.074042:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789683517.074044:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454da00, rc 0) 00000100:00100000:0.0:1789683517.074064:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+29:11911:x1876618835487616:12345-192.168.201.50@tcp:101:bash.0 Request processed in 4912us (5113us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1789683517.074069:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 205 00000100:00100000:2.0:1789683517.077649:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683517.077756:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835487872 00000100:00100000:1.0:1789683517.077767:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835487872 00000100:00100000:1.0:1789683517.077952:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 206 00000100:00100000:1.0:1789683517.077963:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e836a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+29:11911:x1876618835487872:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:1.0:1789683517.077992:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683517.078014:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a3cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc807 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.078044:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a3d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.078057:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.078067:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.078187:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a3cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc807 expref: 31 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.078206:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc807 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.078215:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504a00) 00010000:00010000:1.0:1789683517.078218:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789683517.078222:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dac00, rc 0) 00000100:00100000:1.0:1789683517.078329:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e836a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+30:11911:x1876618835487872:12345-192.168.201.50@tcp:101:bash.0 Request processed in 368us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683517.078337:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 206 00000100:00100000:2.0:1789683517.088307:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683517.088388:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835488128 00000100:00100000:0.0:1789683517.088400:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835488128 00000100:00100000:0.0:1789683517.088465:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 207 00000100:00100000:0.0:1789683517.088475:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+30:11911:x1876618835488128:12345-192.168.201.50@tcp:36:bash.0 00010000:00010000:0.0:1789683517.088740:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3db lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.088758:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.088770:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789683517.088860:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1789683517.088883:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000544fec9 reply state 00000000e7f90902 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.088895:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.088901:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504a00) 00010000:00010000:0.0:1789683517.088903:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789683517.088920:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789683517.088977:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1789683517.089053:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+34:11911:x1876618835488128:12345-192.168.201.50@tcp:36:bash.0 Request processed in 579us (756us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789683517.089060:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 207 00000020:00080000:0.0:1789683517.089065:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789683517.091352:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683517.091915:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835488256 00000100:00100000:0.0:1789683517.091927:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835488256 00000100:00100000:0.0:1789683517.092085:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 208 00000100:00100000:0.0:1789683517.092096:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+34:11911:x1876618835488256:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789683517.092116:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683517.092136:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a3e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc80e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.092193:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a3e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc80e expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.092205:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a3e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc80e expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.092224:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504a00) 00010000:00010000:0.0:1789683517.092227:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789683517.092231:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d000, rc 0) 00000100:00100000:0.0:1789683517.092295:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+35:11911:x1876618835488256:12345-192.168.201.50@tcp:101:bash.0 Request processed in 201us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683517.092302:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 208 00000100:00100000:2.0:1789683517.095934:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683517.095990:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835488384 00000100:00100000:3.0:1789683517.096000:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835488384 00000100:00080000:1.0:1789683517.096043:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683517.096068:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:3.0:1789683517.096078:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+7:11911:x1876618835488384:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789683517.096112:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683517.096136:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001185ae65/0xcf8485587b88a3e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc815 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683517.096162:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aac673a, atime: 0x6aac6738, ctime: 0x6aac673a, blocks: 0x8 00010000:00010000:3.0:1789683517.096256:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=431s v=(0 0) 00010000:00010000:3.0:1789683517.096262:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683517.096271:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001185ae65/0xcf8485587b88a3e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc815 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.096290:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001185ae65/0xcf8485587b88a3e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc815 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.096303:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176c00, rc 0) 00000100:00100000:3.0:1789683517.096361:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+8:11911:x1876618835488384:12345-192.168.201.50@tcp:101:bash.0 Request processed in 284us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683517.096369:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:2.0:1789683517.097731:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683517.097805:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835488512 00000100:00100000:1.0:1789683517.097811:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835488512 00002000:00010000:1.0:1789683517.097855:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1789683517.097859:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e83f17100 with x1876618835488512 ext(0->18446744073709551615) 00002000:00010000:1.0:1789683517.097869:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0e83f17100. 00000100:00100000:1.0:1789683517.097888:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:1.0:1789683517.097895:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec036ece-1720-411a-849c-c978dbb41f8a+8:2402:x1876618835488512:12345-192.168.201.50@tcp:10:bash.0 00002000:00010000:1.0:1789683517.098106:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789683517.098108:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789683514 -> 1789683517 00002000:00010000:1.0:1789683517.098110:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1789683512 -> 1789683512 00002000:00010000:1.0:1789683517.098111:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789683514 -> 1789683517 00002000:00010000:1.0:1789683517.098114:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1789683517.098164:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec036ece-1720-411a-849c-c978dbb41f8a+9:2402:x1876618835488512:12345-192.168.201.50@tcp:10:bash.0 Request processed in 270us (437us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789683517.098170:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 6 00002000:00010000:1.0:1789683517.098173:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1789683517.098176:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e83f17100 with x1876618835488512 ext(0->18446744073709551615) 00002000:00010000:1.0:1789683517.098180:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0e83f17100. 00000100:00100000:1.0:1789683517.146910:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683517.147055:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835488640 00000100:00100000:2.0:1789683517.147066:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835488640 00000100:00100000:2.0:1789683517.147137:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 209 00000100:00100000:2.0:1789683517.147149:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+35:12401:x1876618835488640:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:2.0:1789683517.147221:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a3f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147239:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147251:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147266:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a3f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147274:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147282:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147366:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a3fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147375:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a3fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147398:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a3fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683517.147444:0:12533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a3fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147455:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147462:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a3f0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147469:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147475:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683517.147479:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147486:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a3f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147496:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:2.0:1789683517.147499:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683517.147504:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a3f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147510:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a3f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147523:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147535:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a3f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147541:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147546:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683517.147549:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147556:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a3f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147564:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0f85396600) 00010000:00010000:2.0:1789683517.147567:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683517.147570:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a3f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147576:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a3f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147590:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a3fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147596:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a3fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147602:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a3fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147607:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683517.147616:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a3fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147622:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a3fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147629:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504a00) 00010000:00010000:2.0:1789683517.147631:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683517.147635:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a3fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.147640:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a3fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683517.147718:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+35:12401:x1876618835488640:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 570us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683517.147725:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 209 00000100:00100000:2.0:1789683517.182690:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683517.182876:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835488896 00000100:00100000:1.0:1789683517.182887:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835488896 00000100:00100000:1.0:1789683517.182955:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 210 00000100:00100000:1.0:1789683517.182967:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+35:12404:x1876618835488896:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789683517.183007:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683517.183031:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a405 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc81c expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183123:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a40c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183149:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a40c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183162:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a40c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183177:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a413 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183185:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183191:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183306:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a41a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183316:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a41a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183324:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a41a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683517.183334:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789683517.183420:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a40c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183428:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a40c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183435:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a40c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183441:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837db600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683517.183446:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a40c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183467:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a40c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183478:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:1.0:1789683517.183482:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683517.183487:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a40c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183494:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a40c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183511:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183516:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a413 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183522:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183526:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837daa00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683517.183535:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183540:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a413 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183547:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0fb8504600) 00010000:00010000:1.0:1789683517.183549:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683517.183552:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a413 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183557:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a413 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183601:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a405 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc81c expref: 38 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183614:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a41a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc81c expref: 37 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.183622:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504a00) 00010000:00010000:1.0:1789683517.183624:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789683517.183627:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da200, rc 0) 00000100:00100000:1.0:1789683517.183700:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+37:12404:x1876618835488896:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 735us (1021us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1789683517.183707:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 210 00000100:00100000:1.0:1789683517.190529:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683517.190629:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835489024 00000100:00100000:0.0:1789683517.190640:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835489024 00000100:00100000:0.0:1789683517.190704:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 211 00000100:00100000:0.0:1789683517.190723:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+37:12404:x1876618835489024:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:0.0:1789683517.190834:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a428 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.190861:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88a3bf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc800 expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.190871:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a428 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.190905:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88a3bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc800 expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.190919:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88a3bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc800 expref: 37 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683517.190933:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f18700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850226048:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789683517.191027:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e92780 going to sleep for 11 seconds 00000100:00100000:0.0:1789683517.193732:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f18700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850226048:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683517.193759:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a428 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683517.195196:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683517.195568:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835489280 00000100:00100000:3.0:1789683517.195577:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835489280 00000100:00100000:3.0:1789683517.195661:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:3.0:1789683517.195671:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+38:6173:x1876618835489280:12345-192.168.201.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789683517.196028:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+39:6173:x1876618835489280:12345-192.168.201.50@tcp:35:ldlm_bl.0 Request processed in 358us (838us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789683517.196035:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:3.0:1789683517.197903:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683517.198006:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835489408 00000100:00100000:1.0:1789683517.198016:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835489408 00010000:00010000:1.0:1789683517.198061:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88a3bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc800 expref: 39 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683517.198104:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 95 00000100:00100000:1.0:1789683517.198114:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84488700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+39:2403:x1876618835489408:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683517.198137:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683517.198144:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88a3bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc800 expref: 39 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.198159:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88a3bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc800 expref: 39 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.198182:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88a3bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc800 expref: 39 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.198198:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504a00) 00010000:00010000:1.0:1789683517.198204:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a428 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.198214:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a428 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.198222:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a428 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.198259:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683517.198321:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84488700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+38:2403:x1876618835489408:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 208us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683517.198329:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 95 00010000:00010000:0.0:1789683517.198406:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a428 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.198415:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a428 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.198450:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a428 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.198463:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a428 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.198469:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a428 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.198474:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454de00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683517.198478:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a428 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.198486:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a428 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.198494:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504a00) 00010000:00010000:0.0:1789683517.198497:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789683517.198501:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a428 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.198506:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a428 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683517.198543:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+37:12404:x1876618835489024:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 7824us (8024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683517.198551:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 211 00000100:00100000:2.0:1789683517.201391:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683517.201604:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835489664 00000100:00100000:1.0:1789683517.201616:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835489664 00000100:00100000:1.0:1789683517.201675:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:1.0:1789683517.201684:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+37:12404:x1876618835489664:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:1.0:1789683517.201956:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+38:12404:x1876618835489664:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 271us (573us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1789683517.201964:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:3.0:1789683517.266849:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683517.266953:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835489920 00000100:00100000:0.0:1789683517.266964:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835489920 00000100:00100000:0.0:1789683517.267024:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 212 00000100:00100000:0.0:1789683517.267032:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e84422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+38:12415:x1876618835489920:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:0.0:1789683517.267054:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683517.267085:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a42f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc823 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267158:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a436 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267176:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a436 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267188:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a436 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267202:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a43d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267210:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a43d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267217:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a43d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267334:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a444 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267343:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a444 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267351:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a444 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683517.267361:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789683517.267432:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a436 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267463:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a436 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267470:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a436 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267476:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683517.267481:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a436 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267488:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a436 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267500:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:0.0:1789683517.267503:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683517.267509:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a436 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267516:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d600/0xcf8485587b88a436 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267530:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a43d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267534:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a43d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267538:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a43d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267540:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683517.267547:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a43d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267551:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a43d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267557:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0e835ace00) 00010000:00010000:0.0:1789683517.267558:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683517.267560:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a43d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267563:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a43d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267593:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a42f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc823 expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267601:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a444 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc823 expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.267605:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504a00) 00010000:00010000:0.0:1789683517.267607:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683517.267608:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454c600, rc 0) 00000100:00100000:0.0:1789683517.267659:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e84422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+40:12415:x1876618835489920:12345-192.168.201.50@tcp:101:cat.0 Request processed in 629us (832us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789683517.267664:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 212 00000100:00100000:0.0:1789683517.271646:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683517.271724:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835490176 00000100:00100000:1.0:1789683517.271733:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835490176 00000100:00100000:1.0:1789683517.271813:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:1.0:1789683517.271824:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+40:12415:x1876618835490176:12345-192.168.201.50@tcp:35:cat.0 00000100:00100000:1.0:1789683517.272086:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+41:12415:x1876618835490176:12345-192.168.201.50@tcp:35:cat.0 Request processed in 264us (449us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1789683517.272091:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:2.0:1789683517.284282:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683517.284418:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835490432 00000100:00100000:1.0:1789683517.284426:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835490432 00000100:00100000:1.0:1789683517.284478:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 213 00000100:00100000:1.0:1789683517.284488:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+41:12416:x1876618835490432:12345-192.168.201.50@tcp:36:rm.0 00010000:00010000:1.0:1789683517.284547:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1789683517.284568:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a3e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc80e expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.284585:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a444 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc823 expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.284592:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a41a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc81c expref: 39 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.284615:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a3d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc807 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.284621:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504a00) 00010000:00010000:1.0:1789683517.284624:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789683517.284640:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a452 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.284649:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a452 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.284656:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a452 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.284664:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a459 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.284668:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a459 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.284672:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a459 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.284742:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a460 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.284747:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a460 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.284751:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a460 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789683517.285045:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1789683517.285054:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 431334269965ns, next at 432334267760ns, rc = 0 00010000:00010000:1.0:1789683517.285095:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a467 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285104:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a467 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285111:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a467 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285117:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a467 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285123:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a467 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285128:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a467 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285371:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683517.285391:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a460 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285397:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a460 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285404:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a460 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285410:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dbc00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683517.285419:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a460 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285428:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a460 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285436:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504a00) 00010000:00010000:1.0:1789683517.285439:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789683517.285443:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a460 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285449:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a460 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285464:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a452 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285471:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a452 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285477:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a452 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285481:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81391a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683517.285484:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a452 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285490:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a452 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285497:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:1.0:1789683517.285499:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683517.285507:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a452 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285513:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391a00/0xcf8485587b88a452 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789683517.285524:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5cd5ebf reply state 0000000098893e1e transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a459 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285533:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a459 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.285539:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0fb8504600) 00010000:00010000:1.0:1789683517.285541:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789683517.285544:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789683517.285615:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+39:12416:x1876618835490432:12345-192.168.201.50@tcp:36:rm.0 Request processed in 1127us (1342us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789683517.285622:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 213 00010000:00010000:3.0:1789683517.286422:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683517.286430:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a467 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.286438:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837daa00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683517.286441:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a467 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.286447:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a467 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.286460:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504a00) 00010000:00010000:3.0:1789683517.286464:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789683517.286467:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a467 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.286472:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a467 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.286484:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683517.286486:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683517.286487:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683517.339904:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683517.340025:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835490688 00000100:00100000:2.0:1789683517.340036:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835490688 00000100:00100000:2.0:1789683517.340090:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 214 00000100:00100000:2.0:1789683517.340100:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+39:12422:x1876618835490688:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683517.340126:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683517.340148:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a46e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc82a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.340357:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a475 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.340383:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a475 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.340394:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a475 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.340406:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a47c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.340413:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a47c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.340419:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a47c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789683517.340816:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789683517.340945:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a483 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.340956:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.340963:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.340990:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a475 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.340997:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a475 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.341004:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a475 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.341017:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683517.341021:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a475 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.341029:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a475 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.341041:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:2.0:1789683517.341043:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683517.341048:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a475 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.341054:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a475 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683517.341067:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae8caace reply state 000000007156a4ee transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a47c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.341076:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a47c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.341082:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0fb8504600) 00010000:00010000:2.0:1789683517.341085:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789683517.341087:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789683517.341111:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a46e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc82a expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.341125:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a483 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc82a expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.341142:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396600) 00010000:00010000:2.0:1789683517.341145:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683517.341147:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30200, rc 0) 00000100:00100000:2.0:1789683517.341277:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+42:12422:x1876618835490688:12345-192.168.201.50@tcp:101:bash.0 Request processed in 1178us (1382us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1789683517.341285:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 214 00000100:00100000:2.0:1789683517.352687:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683517.352759:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835490816 00000100:00100000:1.0:1789683517.352771:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835490816 00000100:00100000:1.0:1789683517.352886:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 68 00000100:00100000:1.0:1789683517.352898:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+7:2402:x1876618835490816:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:1.0:1789683517.352922:0:14000:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683517.352945:0:14000:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b88a491 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc831 expref: -99 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789683517.352972:0:14000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789683517.352992:0:14000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789683517.352996:0:14000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683517.353005:0:14000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b88a491 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc831 expref: 8 pid: 14000 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.353038:0:14000:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b88a491 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc831 expref: 8 pid: 14000 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.353053:0:14000:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dac00, rc 0) 00000100:00100000:1.0:1789683517.353104:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+8:2402:x1876618835490816:12345-192.168.201.50@tcp:101:bash.0 Request processed in 208us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683517.353111:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 68 00000100:00100000:1.0:1789683517.356590:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683517.356673:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835490944 00000100:00100000:2.0:1789683517.356684:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835490944 00000100:00100000:2.0:1789683517.356741:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:2.0:1789683517.356750:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+8:12422:x1876618835490944:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683517.356770:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683517.356815:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b88a498 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc838 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.356858:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b88a491 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc831 expref: 9 pid: 14000 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.356868:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683517.356874:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683517.356880:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b88a498 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc838 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.356910:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b88a491 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc831 expref: 9 pid: 14000 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.356935:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b88a491 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc831 expref: 9 pid: 14000 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683517.356947:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83760e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8440:1876618850226176:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683517.357037:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e836bdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683517.360189:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83760e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8440:1876618850226176:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683517.360557:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b88a498 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc838 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.360577:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31200, rc 0) 00000100:00100000:2.0:1789683517.360643:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+9:12422:x1876618835490944:12345-192.168.201.50@tcp:101:bash.0 Request processed in 3892us (4062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683517.360651:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:1.0:1789683517.361000:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683517.361064:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835491072 00000100:00100000:2.0:1789683517.361076:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835491072 00010000:00010000:2.0:1789683517.361107:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b88a491 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc831 expref: 9 pid: 14000 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683517.361141:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 96 00000100:00100000:2.0:1789683517.361150:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84446c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+9:2405:x1876618835491072:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683517.361165:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683517.361187:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b88a491 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc831 expref: 9 pid: 14000 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.361361:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b88a491 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc831 expref: 9 pid: 14000 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.361385:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b3407af/0xcf8485587b88a491 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc831 expref: 9 pid: 14000 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.361401:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683517.361405:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683517.361412:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b88a498 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc838 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.361422:0:10343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b88a498 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc838 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.361450:0:10343:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b88a498 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc838 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683517.361463:0:10343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83760e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10343:1876618850226304:192.168.201.50@tcp:105: 00000100:00100000:2.0:1789683517.361517:0:10343:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e836bdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683517.368120:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683517.368213:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835491328 00000100:00100000:1.0:1789683517.368222:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835491328 00000100:00100000:1.0:1789683517.368419:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:1.0:1789683517.368431:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+42:12422:x1876618835491328:12345-192.168.201.50@tcp:35:bash.0 00000100:00100000:1.0:1789683517.368738:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+43:12422:x1876618835491328:12345-192.168.201.50@tcp:35:bash.0 Request processed in 310us (628us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1789683517.368743:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:2.0:1789683517.368872:0:10343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83760e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10343:1876618850226304:192.168.201.50@tcp:105: 00010000:00010000:2.0:1789683517.368899:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683517.368930:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84446c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+8:2405:x1876618835491072:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 7781us (7930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683517.368938:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 96 00010000:00010000:1.0:1789683517.474614:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683517.526736:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683517.526923:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835491456 00000100:00100000:2.0:1789683517.526935:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835491456 00000100:00100000:2.0:1789683517.527004:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 215 00000100:00100000:2.0:1789683517.527016:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+43:12438:x1876618835491456:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683517.527045:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683517.527069:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a49f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc83f expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.527141:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a4a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.527158:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.527184:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683517.527238:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789683517.527242:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683517.527265:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.527291:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a49f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc83f expref: 45 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.527325:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc83f expref: 44 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.527334:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:2.0:1789683517.527337:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683517.527358:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30600, rc 0) 00000100:00100000:2.0:1789683517.527427:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+44:12438:x1876618835491456:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 414us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683517.527434:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 215 00000100:00100000:2.0:1789683517.535113:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850226432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683517.535211:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683517.535414:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850226432 00000100:00100000:1.0:1789683517.535424:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850226432 00000100:00100000:1.0:1789683517.535510:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789683517.535521:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850226432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789683517.535557:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789683517.535619:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850226432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683517.535644:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789683517.535710:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850226432:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789683517.536098:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683517.536545:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683517.536661:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835491712 00000100:00100000:1.0:1789683517.536668:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835491712 00000100:00100000:1.0:1789683517.536853:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 216 00000100:00100000:1.0:1789683517.536864:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+44:12438:x1876618835491712:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789683517.536880:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683517.536904:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a4ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc846 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.537037:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.537054:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.537070:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683517.537083:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789683517.537428:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a4ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc846 expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.537449:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc846 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.537457:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396600) 00010000:00010000:1.0:1789683517.537460:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683517.537472:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837db600, rc 0) 00000100:00100000:1.0:1789683517.537586:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+46:12438:x1876618835491712:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 724us (1044us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1789683517.537594:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 216 00000100:00100000:0.0:1789683517.542611:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683517.542702:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683517.542772:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835491968 00000100:00100000:2.0:1789683517.542801:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835491968 00000100:00100000:2.0:1789683517.542872:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 217 00000100:00100000:2.0:1789683517.542883:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+46:12438:x1876618835491968:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683517.542909:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683517.542930:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88a4c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc84d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.543053:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a4c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.543071:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a4c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.543084:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a4c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683517.543097:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789683517.543231:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88a4c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc84d expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.543250:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a4c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc84d expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.543275:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396600) 00010000:00010000:2.0:1789683517.543278:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789683517.543282:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30a00, rc 0) 00000100:00100000:2.0:1789683517.543354:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+48:12438:x1876618835491968:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 472us (651us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1789683517.543361:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 217 00000100:00100000:1.0:1789683517.547777:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835492096 00000100:00100000:1.0:1789683517.547816:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835492096 00000100:00100000:1.0:1789683517.547908:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:1.0:1789683517.547919:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83ead180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+48:2405:x1876618835492096:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683517.547942:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683517.547967:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc846 expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.547988:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396600) 00010000:00010000:1.0:1789683517.547993:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683517.548072:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83ead180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+47:2405:x1876618835492096:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 155us (5469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683517.548079:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:0.0:1789683517.553423:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683517.553555:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835492224 00000100:00100000:3.0:1789683517.553568:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835492224 00000100:00100000:3.0:1789683517.553637:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 70 00000100:00100000:3.0:1789683517.553649:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+8:2403:x1876618835492224:12345-192.168.201.50@tcp:1:lfs.0 00010000:00010000:3.0:1789683517.553702:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a4d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.553723:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b88a498 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc838 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.553747:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683517.553753:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683517.553758:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a4d7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.553847:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b88a498 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc838 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.553860:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b88a498 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc838 expref: 8 pid: 8440 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683517.553874:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8437:1876618850226560:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789683517.553952:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f98fc3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683517.558134:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683517.558237:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835492352 00000100:00100000:1.0:1789683517.558246:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835492352 00002000:00100000:1.0:1789683517.558306:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9f0e83eaea00 x1876618835492352/t0(0) o4->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:573/0 lens 504/0 e 0 to 0 dl 1789683528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789683517.558318:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e83eaea00 with x1876618835492352 ext(0->8) 00010000:00010000:1.0:1789683517.558328:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b88a498 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc838 expref: 9 pid: 8440 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.558344:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b88a498 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc838 expref: 9 pid: 8440 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789683517.558372:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f0e83eaea00 00000100:00100000:1.0:1789683517.558408:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:1.0:1789683517.558418:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec036ece-1720-411a-849c-c978dbb41f8a+9:2403:x1876618835492352:12345-192.168.201.50@tcp:4:lfs.0 00000100:00100000:1.0:1789683517.559919:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec036ece-1720-411a-849c-c978dbb41f8a+11:2403:x1876618835492352:12345-192.168.201.50@tcp:4:lfs.0 Request processed in 1495us (1796us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789683517.559931:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 3 00002000:00100000:1.0:1789683517.559945:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9f0e83eaea00 x1876618835492352/t4294967309(0) o4->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:573/0 lens 504/448 e 0 to 0 dl 1789683528 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789683517.559956:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e83eaea00 with x1876618835492352 ext(0->8) 00010000:00010000:1.0:1789683517.559965:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b88a498 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc838 expref: 11 pid: 8440 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.559983:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b88a498 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc838 expref: 11 pid: 8440 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789683517.559992:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f0e83eaea00 00000100:00100000:3.0:1789683517.563695:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683517.563946:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835492480 00000100:00100000:1.0:1789683517.563957:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835492480 00010000:00010000:1.0:1789683517.563998:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b88a498 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc838 expref: 11 pid: 8440 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683517.564082:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 97 00000100:00100000:1.0:1789683517.564092:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+11:2402:x1876618835492480:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683517.564133:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789683517.564151:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789683517.564154:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789683517 00002000:00010000:1.0:1789683517.564157:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789683517 00002000:00010000:1.0:1789683517.564165:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789683517 00002000:00010000:1.0:1789683517.564168:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789683517.564175:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b88a498 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc838 expref: 11 pid: 8440 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.564190:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b88a498 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc838 expref: 11 pid: 8440 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.564216:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789683517.564221:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789683517.564228:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a4d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.564239:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a4d7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.564262:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683517.564327:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+11:2402:x1876618835492480:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 236us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683517.564335:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 97 00010000:00010000:2.0:1789683517.564425:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f519eb4/0xcf8485587b88a498 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc838 expref: 10 pid: 8440 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683517.564442:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8437:1876618850226560:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683517.564461:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a4d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.564471:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a4d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.564479:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a4d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.564500:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a4d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.564506:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a4d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.564527:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a4d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.564535:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683517.564539:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a4d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.564548:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a4d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.564559:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a4d7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.564566:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88a4d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683517.564613:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+9:2403:x1876618835492224:12345-192.168.201.50@tcp:1:lfs.0 Request processed in 10966us (11202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683517.564621:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 70 00000100:00100000:0.0:1789683517.568780:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000001:00080000:1.0:1789683517.568863:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1789683517.568878:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1789683517.571262:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835492736 00000100:00100000:1.0:1789683517.571299:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835492736 00000100:00100000:1.0:1789683517.571397:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:1.0:1789683517.571408:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f867cb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+47:12438:x1876618835492736:12345-192.168.201.50@tcp:35:lfs.0 00000004:00010000:1.0:1789683517.571491:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a4c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc84d expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789683517.571694:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1789683517.571733:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1789683517.572079:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1789683517.572136:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4de lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.572152:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a483 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc82a expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.572389:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4de lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.572426:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a483 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc82a expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.572441:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a483 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc82a expref: 51 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683517.572618:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1876618850226688:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789683517.572814:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fa512bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683517.576749:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683517.576890:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835492864 00000100:00100000:2.0:1789683517.576901:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835492864 00010000:00010000:2.0:1789683517.576953:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a483 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc82a expref: 52 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683517.576996:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 98 00000100:00100000:2.0:1789683517.577022:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83ead500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+52:2403:x1876618835492864:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683517.577039:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683517.577047:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a483 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc82a expref: 52 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.577060:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a483 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc82a expref: 52 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.577084:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396600) 00010000:00010000:2.0:1789683517.577090:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4de lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.577099:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.577107:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4de lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.577139:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683517.577212:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83ead500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+52:2403:x1876618835492864:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 191us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683517.577219:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 98 00010000:00010000:1.0:1789683517.577884:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a483 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc82a expref: 51 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683517.577918:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1876618850226688:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789683517.577942:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.577951:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.577956:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789683517.578061:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1789683517.578249:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1789683517.578577:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876618850226816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789683517.578630:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683517.578668:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f899f9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683517.578840:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850226816 00000100:00100000:0.0:1789683517.578847:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850226816 00000100:00100000:0.0:1789683517.578900:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789683517.578910:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1876618850226816:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789683517.579006:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1876618850226816:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 98us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683517.579013:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789683517.579695:0:6524:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:3.0:1789683517.579703:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:3.0:1789683517.579727:0:6524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0fc070ad80, transno 4294967308 00000100:00100000:3.0:1789683517.579754:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876618850226816:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789683517.579946:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1789683517.580028:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876618850226944:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789683517.580082:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683517.580135:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850226944 00000100:00100000:3.0:1789683517.580141:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850226944 00000100:00080000:2.0:1789683517.580269:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683517.581154:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789683517.581594:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa50b5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1876618850226944:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789683517.581866:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa50b5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6524:x1876618850226944:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 281us (1783us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789683517.581874:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789683517.582186:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fa512b180 going to sleep for 11 seconds 00000100:00100000:3.0:1789683517.582220:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876618850226944:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789683517.582284:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1789683517.582775:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.582813:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4de lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.582821:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4de lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.582827:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837db600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683517.582842:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4de lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.582851:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4de lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.582867:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396600) 00010000:00010000:3.0:1789683517.582870:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789683517.582874:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4de lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.582880:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4de lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789683517.582990:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789683517.583060:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1789683517.583073:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 431632288808ns, next at 432632286200ns, rc = 0 00000001:00080000:3.0:1789683517.583080:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1789683517.583102:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396600) 00010000:00010000:3.0:1789683517.583105:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789683517.583126:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a4c9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc84d expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683517.583650:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f867cb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+54:12438:x1876618835492736:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 12241us (14877us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789683517.583660:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 56 00000020:00080000:3.0:1789683517.583665:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789683517.589578:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683517.589650:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835492992 00000100:00100000:2.0:1789683517.589659:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835492992 00000100:00100000:2.0:1789683517.589755:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 218 00000100:00100000:2.0:1789683517.589764:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+54:12438:x1876618835492992:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683517.589819:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683517.589867:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88a4e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc854 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.589926:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88a4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc854 expref: 55 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.589940:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88a4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc854 expref: 55 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.589960:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:2.0:1789683517.589963:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683517.589967:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31400, rc 0) 00000100:00100000:2.0:1789683517.590028:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+55:12438:x1876618835492992:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 264us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683517.590035:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 218 00000100:00100000:2.0:1789683517.596909:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683517.597354:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835493248 00000100:00100000:1.0:1789683517.597365:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835493248 00000100:00100000:1.0:1789683517.597474:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:1.0:1789683517.597484:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+55:12438:x1876618835493248:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:1.0:1789683517.597739:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+56:12438:x1876618835493248:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 256us (839us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789683517.597748:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:3.0:1789683517.685260:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683517.685413:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835493376 00000100:00100000:1.0:1789683517.685424:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835493376 00000100:00100000:1.0:1789683517.685503:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 219 00000100:00100000:1.0:1789683517.685515:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+56:12447:x1876618835493376:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:1.0:1789683517.685616:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a4ec lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.685636:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a4ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.685649:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a4ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.685660:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.685668:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.685674:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.685772:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a4fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.685780:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a4fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.685839:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a4fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789683517.685898:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a4fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.685912:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a4ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.685929:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a4ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.685936:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a4ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.685942:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837da200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683517.685948:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a4ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.685956:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a4ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.685969:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:1.0:1789683517.685971:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683517.685976:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a4ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.685982:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a4ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.685999:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.686005:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.686010:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.686014:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837db600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683517.686024:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.686030:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.686036:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0fb8504600) 00010000:00010000:1.0:1789683517.686039:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683517.686042:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.686047:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a4f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.686056:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a4fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.686061:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a4fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.686066:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a4fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.686071:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dac00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683517.686074:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a4fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.686080:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a4fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.686085:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:1.0:1789683517.686087:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683517.686095:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a4fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.686102:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a4fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683517.686190:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+56:12447:x1876618835493376:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 677us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683517.686198:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 219 00000100:00100000:0.0:1789683517.727208:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683517.727390:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835493632 00000100:00100000:3.0:1789683517.727402:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835493632 00000100:00100000:3.0:1789683517.727478:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 220 00000100:00100000:3.0:1789683517.727490:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+56:12451:x1876618835493632:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789683517.727512:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683517.727536:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b88a501 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc85b expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.727621:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b88a508 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.727640:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b88a508 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.727654:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b88a508 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.727689:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b88a50f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.727698:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b88a50f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.727706:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b88a50f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.727885:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a516 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.727894:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a516 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.727902:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a516 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683517.727913:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789683517.728013:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b88a508 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.728021:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b88a508 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.728028:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b88a508 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.728034:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683517.728039:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b88a508 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.728058:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b88a508 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.728072:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:3.0:1789683517.728075:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683517.728080:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b88a508 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.728088:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176400/0xcf8485587b88a508 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.728103:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b88a50f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.728123:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b88a50f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.728130:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b88a50f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.728135:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683517.728138:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b88a50f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.728144:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b88a50f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.728151:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0fb8504600) 00010000:00010000:3.0:1789683517.728154:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683517.728157:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b88a50f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.728172:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177e00/0xcf8485587b88a50f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.728208:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b88a501 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc85b expref: 59 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.728223:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a516 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc85b expref: 58 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.728230:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:3.0:1789683517.728232:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683517.728235:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176600, rc 0) 00000100:00100000:3.0:1789683517.728526:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+58:12451:x1876618835493632:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 1037us (1325us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1789683517.728535:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 220 00000100:00100000:3.0:1789683517.731916:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683517.732140:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835493760 00000100:00100000:2.0:1789683517.732151:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835493760 00000100:00100000:2.0:1789683517.732219:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 221 00000100:00100000:2.0:1789683517.732230:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+58:12451:x1876618835493760:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:2.0:1789683517.732316:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a524 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.732337:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a524 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.732350:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a524 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.732423:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a524 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.732431:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a524 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.732438:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a524 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.732444:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683517.732448:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a524 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.732465:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a524 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.732479:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:2.0:1789683517.732483:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789683517.732488:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a524 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.732494:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a524 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683517.732594:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+58:12451:x1876618835493760:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 366us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683517.732603:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 221 00000100:00100000:1.0:1789683517.737146:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683517.737289:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835494016 00000100:00100000:3.0:1789683517.737309:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835494016 00000100:00100000:3.0:1789683517.737367:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:3.0:1789683517.737377:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+58:12451:x1876618835494016:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789683517.737655:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+59:12451:x1876618835494016:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 278us (523us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1789683517.737664:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:0.0:1789683517.820346:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683517.820461:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835494272 00000100:00100000:2.0:1789683517.820473:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835494272 00000100:00100000:2.0:1789683517.820544:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 222 00000100:00100000:2.0:1789683517.820575:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+59:12461:x1876618835494272:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683517.820610:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683517.820614:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789683517.820644:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a4a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc83f expref: 59 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.820666:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:2.0:1789683517.820673:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683517.820690:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a52b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc862 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.820905:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a532 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.820920:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a516 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc85b expref: 59 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.820928:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a532 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.820967:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a516 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc85b expref: 59 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.820981:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a516 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc85b expref: 59 pid: 12533 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683517.820995:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83762680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850227072:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683517.821158:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e836bd300 going to sleep for 11 seconds 00000100:00100000:2.0:1789683517.827758:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683517.827877:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83762680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850227072:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683517.827906:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a532 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683517.828392:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835494400 00000100:00100000:3.0:1789683517.828402:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835494400 00010000:00010000:3.0:1789683517.828544:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a516 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc85b expref: 60 pid: 12533 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683517.828611:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 99 00000100:00100000:3.0:1789683517.828623:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+60:2402:x1876618835494400:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683517.828641:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683517.828649:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a516 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc85b expref: 60 pid: 12533 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.828662:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a516 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc85b expref: 60 pid: 12533 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.828688:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a516 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc85b expref: 60 pid: 12533 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.828705:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:3.0:1789683517.828710:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a532 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.828721:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a532 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.828729:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a532 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.828761:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683517.828870:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+59:2402:x1876618835494400:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 250us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683517.828878:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 99 00010000:00010000:0.0:1789683517.828951:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a532 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.828958:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a532 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683517.828980:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789683517.829142:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a52b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc862 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.829176:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a532 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc862 expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.829184:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:0.0:1789683517.829188:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789683517.829190:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30800, rc 0) 00000100:00100000:0.0:1789683517.829218:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+59:12461:x1876618835494272:12345-192.168.201.50@tcp:101:bash.0 Request processed in 8646us (8883us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1789683517.829225:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 222 00000100:00100000:1.0:1789683517.832682:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683517.832765:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835494528 00000100:00100000:0.0:1789683517.832777:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835494528 00000100:00100000:0.0:1789683517.832987:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 223 00000100:00100000:0.0:1789683517.832998:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+59:12461:x1876618835494528:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789683517.833024:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683517.833047:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a540 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc869 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.833090:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a547 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.833117:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a547 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.833132:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a547 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.833252:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d000/0xcf8485587b88a540 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc869 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.833277:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a547 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc869 expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.833296:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:0.0:1789683517.833299:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789683517.833303:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454c600, rc 0) 00000100:00100000:0.0:1789683517.833366:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+60:12461:x1876618835494528:12345-192.168.201.50@tcp:101:bash.0 Request processed in 370us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683517.833373:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 223 00000100:00100000:3.0:1789683517.835955:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683517.836649:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835494784 00000100:00100000:2.0:1789683517.836660:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835494784 00000100:00100000:2.0:1789683517.836752:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 224 00000100:00100000:2.0:1789683517.836763:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+60:12461:x1876618835494784:12345-192.168.201.50@tcp:36:bash.0 00010000:00010000:2.0:1789683517.837043:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a54e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.837063:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a54e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.837075:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a54e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789683517.837132:0:8462:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1789683517.837159:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7b7f23f reply state 00000000acfb6683 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a54e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.837170:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a54e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.837177:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:2.0:1789683517.837179:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789683517.837184:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683517.837284:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+63:12461:x1876618835494784:12345-192.168.201.50@tcp:36:bash.0 Request processed in 522us (1336us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789683517.837475:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 224 00000020:00080000:2.0:1789683517.837482:0:8462:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789683517.840597:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683517.840663:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835494912 00000100:00100000:0.0:1789683517.840675:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835494912 00000100:00100000:0.0:1789683517.840731:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 225 00000100:00100000:0.0:1789683517.840741:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+63:12461:x1876618835494912:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789683517.840771:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683517.840841:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a555 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc870 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.840939:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a55c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.840955:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a532 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc862 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.840967:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a55c lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.841005:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a532 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc862 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.841034:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a532 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc862 expref: 64 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683517.841049:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850227200:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789683517.841150:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683517.844578:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683517.844915:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835495040 00000100:00100000:2.0:1789683517.844929:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835495040 00010000:00010000:2.0:1789683517.844991:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a532 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc862 expref: 65 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683517.845062:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 100 00000100:00100000:2.0:1789683517.845076:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+65:2402:x1876618835495040:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683517.845103:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683517.845125:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a532 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc862 expref: 65 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.845142:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a532 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc862 expref: 65 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.845172:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:2.0:1789683517.845180:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a55c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.845193:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a55c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.845202:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a55c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.845227:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683517.845316:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+65:2402:x1876618835495040:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 242us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683517.845323:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 100 00010000:00010000:0.0:1789683517.845569:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a532 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc862 expref: 64 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683517.845588:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850227200:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683517.845611:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a55c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.845620:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a55c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.845626:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a55c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683517.845689:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789683517.845694:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683517.845717:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a55c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.845747:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454de00/0xcf8485587b88a555 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc870 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.845760:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a55c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc870 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.845776:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:0.0:1789683517.845779:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683517.845806:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d800, rc 0) 00000100:00100000:0.0:1789683517.845848:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+63:12461:x1876618835494912:12345-192.168.201.50@tcp:101:bash.0 Request processed in 5108us (5260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683517.845856:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 225 00000100:00100000:1.0:1789683517.855519:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683517.855616:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835495296 00000100:00100000:3.0:1789683517.855630:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835495296 00000100:00100000:3.0:1789683517.855694:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:3.0:1789683517.855707:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+63:12461:x1876618835495296:12345-192.168.201.50@tcp:35:bash.0 00000100:00100000:3.0:1789683517.856027:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+64:12461:x1876618835495296:12345-192.168.201.50@tcp:35:bash.0 Request processed in 321us (521us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1789683517.856035:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:1.0:1789683517.931543:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683517.931657:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835495424 00000100:00100000:2.0:1789683517.931667:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835495424 00000100:00100000:2.0:1789683517.931730:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 226 00000100:00100000:2.0:1789683517.931740:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+64:12467:x1876618835495424:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683517.931779:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683517.931862:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a563 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc877 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.931935:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a56a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.931952:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a56a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.931964:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a56a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683517.932014:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789683517.932018:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683517.932040:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a56a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.932067:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88a563 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc877 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.932087:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a56a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc877 expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.932097:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:2.0:1789683517.932101:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683517.932105:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30200, rc 0) 00000100:00100000:2.0:1789683517.932232:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+65:12467:x1876618835495424:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 492us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683517.932240:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 226 00000100:00100000:0.0:1789683517.936104:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683517.936354:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835495552 00000100:00100000:2.0:1789683517.936365:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835495552 00000100:00100000:2.0:1789683517.936474:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 227 00000100:00100000:2.0:1789683517.936486:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa512f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+65:12467:x1876618835495552:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683517.936508:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683517.936529:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a571 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc87e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.936620:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a578 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.936636:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a578 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.936648:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a578 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.936658:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a57f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.936665:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a57f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.936671:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a57f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.936737:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a586 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.936745:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.936761:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683517.937060:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789683517.937065:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683517.937087:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.937102:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.937122:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a578 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.937129:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a578 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.937136:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a578 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.937142:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683517.937146:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a578 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.937154:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a578 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.937166:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:2.0:1789683517.937169:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683517.937174:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a578 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.937191:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88a578 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.937204:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a57f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.937210:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a57f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.937216:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a57f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.937222:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683517.937225:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a57f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.937232:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a57f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.937239:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0fb8504600) 00010000:00010000:2.0:1789683517.937242:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683517.937245:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a57f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.937251:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88a57f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.937278:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31200/0xcf8485587b88a571 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc87e expref: 67 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.937303:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a586 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc87e expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.937317:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:2.0:1789683517.937320:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683517.937323:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30e00, rc 0) 00000100:00100000:2.0:1789683517.937429:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa512f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+66:12467:x1876618835495552:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 945us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683517.937438:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 227 00000100:00100000:0.0:1789683517.949477:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683517.949520:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683517.949734:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835495680 00000100:00100000:3.0:1789683517.949745:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835495680 00000100:00100000:3.0:1789683517.949851:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:3.0:1789683517.949861:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+66:2403:x1876618835495680:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683517.949877:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683517.949904:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88a586 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc87e expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.949925:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:3.0:1789683517.949931:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683517.949985:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+65:2403:x1876618835495680:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 125us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683517.949993:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:2.0:1789683517.950289:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835495936 00000100:00100000:2.0:1789683517.950294:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835495936 00000100:00100000:2.0:1789683517.950324:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 228 00000100:00100000:2.0:1789683517.950330:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+65:12467:x1876618835495936:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683517.950346:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683517.950362:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a58d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc885 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.950484:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88a594 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.950499:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a55c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc870 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.950508:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88a594 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.950543:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a55c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc870 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.950558:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a55c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc870 expref: 66 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683517.950590:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7963800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876618850227328:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683517.950659:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e836bd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683517.954766:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683517.954901:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835496064 00000100:00100000:1.0:1789683517.954912:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835496064 00010000:00010000:1.0:1789683517.954960:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a55c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc870 expref: 67 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683517.955002:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 101 00000100:00100000:1.0:1789683517.955012:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84444850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+67:2402:x1876618835496064:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683517.955030:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683517.955037:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a55c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc870 expref: 67 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.955050:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a55c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc870 expref: 67 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.955083:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:1.0:1789683517.955091:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88a594 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.955136:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88a594 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.955144:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88a594 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683517.955165:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683517.955223:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84444850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+67:2402:x1876618835496064:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 212us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683517.955231:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 101 00010000:00010000:2.0:1789683517.955886:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d800/0xcf8485587b88a55c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc870 expref: 66 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683517.955905:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7963800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876618850227328:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683517.955926:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88a594 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.955936:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88a594 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.955943:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88a594 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683517.955961:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789683517.956095:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31800/0xcf8485587b88a58d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc885 expref: 67 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.956124:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88a594 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc885 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.956133:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:2.0:1789683517.956137:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789683517.956140:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f8600, rc 0) 00000100:00100000:2.0:1789683517.956181:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+66:12467:x1876618835495936:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 5850us (6660us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789683517.956199:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 228 00000100:00100000:0.0:1789683517.963073:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683517.963953:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835496320 00000100:00100000:3.0:1789683517.963965:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835496320 00000100:00100000:3.0:1789683517.964038:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:3.0:1789683517.964049:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+66:12467:x1876618835496320:12345-192.168.201.50@tcp:103:lfs.0 00010000:00010000:3.0:1789683517.964082:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683517.964118:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88a4e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc854 expref: 66 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683517.964140:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:3.0:1789683517.964146:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683517.964224:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+65:12467:x1876618835496320:12345-192.168.201.50@tcp:103:lfs.0 Request processed in 176us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683517.964232:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:1.0:1789683517.970852:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683517.970945:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835496448 00000100:00100000:2.0:1789683517.970956:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835496448 00000100:00100000:2.0:1789683517.971105:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 229 00000100:00100000:2.0:1789683517.971118:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+65:12467:x1876618835496448:12345-192.168.201.50@tcp:58:lfs.0 00010000:00010000:2.0:1789683517.971277:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8000/0xcf8485587b88a5a2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.971294:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8000/0xcf8485587b88a5a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683517.971307:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8000/0xcf8485587b88a5a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789683517.971694:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789683517.971777:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+65:12467:x1876618835496448:12345-192.168.201.50@tcp:58:lfs.0 Request processed in 662us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683517.972082:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 229 00000100:00100000:1.0:1789683517.973670:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683517.973844:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835496576 00000100:00100000:0.0:1789683517.973854:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835496576 00000100:00100000:0.0:1789683517.973955:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 230 00000100:00100000:0.0:1789683517.973966:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+65:12467:x1876618835496576:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789683517.973991:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683517.974015:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b88a5a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc88c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.974076:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8000/0xcf8485587b88a5a2 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.974088:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b88a5a9 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc88c expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.974118:0:6522:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8000/0xcf8485587b88a5a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.974150:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b88a5a9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc88c expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.974166:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:0.0:1789683517.974169:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789683517.974173:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b88a5a9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc88c expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683517.974181:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454c000, rc 0) 00000100:00100000:0.0:1789683517.974242:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+66:12467:x1876618835496576:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 278us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683517.974250:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 230 00000100:00100000:2.0:1789683518.049313:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850227456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789683518.049402:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683518.049508:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850227456 00000100:00100000:2.0:1789683518.049517:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850227456 00000100:00100000:2.0:1789683518.049578:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789683518.049588:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850227456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683518.049630:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789683518.049685:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850227456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683518.049708:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789683518.049752:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850227456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683518.052041:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850227584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683518.052128:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683518.052600:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850227584 00000100:00100000:3.0:1789683518.052610:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850227584 00000100:00100000:3.0:1789683518.052675:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789683518.052685:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1876618850227584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683518.052708:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789683518.052757:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1876618850227584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683518.052764:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789683518.052835:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850227584:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789683518.052899:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1789683518.367049:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789683518.367061:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789683518.367088:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789683518.367099:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789683518.367267:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaf100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1876618850227712:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789683518.367409:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e92c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683518.373464:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaf100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1876618850227712:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789683518.382589:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683518.383130:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835496704 00000100:00100000:0.0:1789683518.383142:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835496704 00000100:00100000:0.0:1789683518.383268:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 231 00000100:00100000:0.0:1789683518.383292:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+66:12468:x1876618835496704:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789683518.383330:0:6523:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789683518.383476:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+66:12468:x1876618835496704:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 198us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683518.383505:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 231 00000100:00100000:1.0:1789683518.389291:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683518.389412:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835496832 00000100:00100000:2.0:1789683518.389424:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835496832 00000100:00100000:2.0:1789683518.389482:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 232 00000100:00100000:2.0:1789683518.389493:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+66:12468:x1876618835496832:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789683518.389571:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a5b0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389590:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a5b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389601:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a5b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389617:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389624:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389630:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389651:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389658:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389678:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683518.389727:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789683518.389731:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683518.389744:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389754:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a5b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389760:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a5b0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389767:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a5b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389773:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683518.389778:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a5b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389895:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a5b0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389910:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0f854c2c00) 00010000:00010000:2.0:1789683518.389913:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683518.389920:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a5b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389927:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a5b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389951:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389957:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5b7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389962:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389967:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683518.389970:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389976:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5b7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389984:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9f0f85396b00) 00010000:00010000:2.0:1789683518.389987:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683518.389990:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5b7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.389995:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5b7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.390010:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.390016:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.390021:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.390031:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683518.390034:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.390040:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.390048:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:2.0:1789683518.390051:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683518.390054:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5be lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.390059:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683518.390156:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+66:12468:x1876618835496832:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 Request processed in 664us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683518.390164:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 232 00000100:00100000:1.0:1789683518.392932:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683518.392978:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835497088 00000100:00100000:0.0:1789683518.392995:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835497088 00000100:00100000:3.0:1789683518.393293:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 233 00000100:00100000:3.0:1789683518.393306:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+66:12468:x1876618835497088:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683518.393328:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683518.393347:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a5c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc893 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.393454:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b88a5cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.393485:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b88a5cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.393498:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b88a5cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683518.393513:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789683518.393593:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b88a5cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.393598:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b88a5cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.393603:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b88a5cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.393607:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683518.393610:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b88a5cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.393615:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b88a5cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.393625:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:3.0:1789683518.393627:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789683518.393630:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b88a5cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.393634:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177600/0xcf8485587b88a5cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.393665:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a5c5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc893 expref: 68 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.393676:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0f854c2c00) 00010000:00010000:3.0:1789683518.393677:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683518.393680:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a5c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc893 expref: 68 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.393687:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176600, rc 0) 00000100:00100000:3.0:1789683518.393746:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+67:12468:x1876618835497088:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 445us (823us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1789683518.393752:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 233 00000100:00100000:3.0:1789683518.397001:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683518.397042:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835497216 00000100:00100000:2.0:1789683518.397053:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835497216 00000100:00100000:2.0:1789683518.397124:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 234 00000100:00100000:2.0:1789683518.397136:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+67:12468:x1876618835497216:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789683518.397188:0:8462:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789683518.397428:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+67:12468:x1876618835497216:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 293us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683518.397436:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 234 00000100:00100000:1.0:1789683518.402563:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683518.402617:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835497472 00000100:00100000:0.0:1789683518.402629:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835497472 00000100:00100000:0.0:1789683518.402699:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 235 00000100:00100000:0.0:1789683518.402711:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+67:12468:x1876618835497472:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683518.402737:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683518.402741:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789683518.402775:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88a56a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc877 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.402845:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:0.0:1789683518.402853:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789683518.402944:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a5da lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc89a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789683518.403419:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:1.0:1789683518.403562:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a5e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.403576:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a5e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.403586:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a5e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.403654:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a5da lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc89a expref: 69 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.403674:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a5e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc89a expref: 68 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.403681:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:1.0:1789683518.403684:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683518.403687:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dbc00, rc 0) 00000100:00100000:1.0:1789683518.403758:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+68:12468:x1876618835497472:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 1051us (1202us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789683518.403767:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 235 00000100:00100000:1.0:1789683518.407742:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683518.407853:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835497728 00000100:00100000:3.0:1789683518.407865:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835497728 00000100:00100000:2.0:1789683518.407935:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 236 00000100:00100000:2.0:1789683518.407950:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+68:12468:x1876618835497728:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789683518.408056:0:12533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683518.408088:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a5e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc89a expref: 68 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408109:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0fb8504300) 00010000:00010000:2.0:1789683518.408120:0:12533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683518.408143:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408159:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408169:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408259:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x3ede3a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408268:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3ede3a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408275:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3ede3a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408320:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408327:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5ef lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408334:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408347:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683518.408351:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408359:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408367:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:2.0:1789683518.408370:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683518.408373:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5ef lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408377:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a5ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408438:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3ede3a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408443:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5f6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3ede3a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408446:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3ede3a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408450:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683518.408452:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3ede3a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408459:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5f6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3ede3a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408477:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x3ede3a95 (ffff9f0f85396b00) 00010000:00010000:2.0:1789683518.408480:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683518.408482:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5f6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x3ede3a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.408489:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a5f6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x3ede3a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683518.408563:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+67:12468:x1876618835497728:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 618us (831us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789683518.408571:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 236 00000100:00100000:3.0:1789683518.410769:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683518.411339:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835497856 00000100:00100000:2.0:1789683518.411349:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835497856 00000100:00100000:2.0:1789683518.411420:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 237 00000100:00100000:2.0:1789683518.411429:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+67:12468:x1876618835497856:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683518.411449:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683518.411473:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a5fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc8a1 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.411513:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a604 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.411528:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a604 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.411539:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a604 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.411658:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a5fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8a1 expref: 69 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.411687:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a604 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8a1 expref: 68 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.411695:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0f85396500) 00010000:00010000:2.0:1789683518.411698:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789683518.411702:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f8200, rc 0) 00000100:00100000:2.0:1789683518.411769:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+68:12468:x1876618835497856:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 341us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683518.411776:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 237 00000100:00100000:1.0:1789683518.415467:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683518.415572:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835498112 00000100:00100000:2.0:1789683518.415584:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835498112 00000100:00100000:2.0:1789683518.415672:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 238 00000100:00100000:2.0:1789683518.415684:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+68:12468:x1876618835498112:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789683518.415777:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a60b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.415893:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a60b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.415907:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a60b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789683518.416088:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1789683518.416274:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 432465488315ns, next at 433465310645ns, rc = 0 00000004:00010000:2.0:1789683518.416402:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf618f26 reply state 00000000c7ad501b transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a60b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.416435:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a60b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.416444:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0f85396500) 00010000:00010000:2.0:1789683518.416447:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789683518.416452:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683518.416613:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+70:12468:x1876618835498112:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 930us (1154us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789683518.416620:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 238 00000100:00100000:1.0:1789683518.423150:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683518.423571:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835498240 00000100:00100000:2.0:1789683518.423589:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835498240 00000100:00100000:2.0:1789683518.423668:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 239 00000100:00100000:2.0:1789683518.423678:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+70:12468:x1876618835498240:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683518.423709:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683518.423734:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a612 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc8a8 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.424047:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a612 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8a8 expref: 71 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.424065:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a612 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8a8 expref: 71 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.424086:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0f85396500) 00010000:00010000:2.0:1789683518.424089:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683518.424093:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f8e00, rc 0) 00000100:00100000:2.0:1789683518.424694:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+71:12468:x1876618835498240:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 599us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683518.424719:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 239 00000100:00100000:2.0:1789683518.427979:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683518.428081:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835498368 00000100:00100000:1.0:1789683518.428091:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835498368 00000100:00100000:1.0:1789683518.428173:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 71 00000100:00100000:1.0:1789683518.428184:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+9:2402:x1876618835498368:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789683518.428644:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+10:2402:x1876618835498368:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 461us (676us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789683518.428652:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 71 00000100:00100000:1.0:1789683518.432093:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683518.432194:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835498624 00000100:00100000:3.0:1789683518.432216:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835498624 00000100:00100000:3.0:1789683518.432278:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:3.0:1789683518.432296:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+71:12468:x1876618835498624:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789683518.432600:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+72:12468:x1876618835498624:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 304us (516us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789683518.432608:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:1.0:1789683518.438349:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683518.441935:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835498880 00000100:00100000:0.0:1789683518.441956:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835498880 00000100:00100000:0.0:1789683518.442032:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 240 00000100:00100000:0.0:1789683518.442044:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+72:12468:x1876618835498880:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789683518.442206:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+72:12468:x1876618835498880:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 165us (3937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683518.442214:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 240 00000100:00100000:2.0:1789683518.446259:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683518.446434:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835499008 00000100:00100000:1.0:1789683518.446461:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835499008 00000100:00100000:1.0:1789683518.446528:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 241 00000100:00100000:1.0:1789683518.446540:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+72:12468:x1876618835499008:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789683518.446562:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683518.446587:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a619 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc8af expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.446655:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a620 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.446668:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a620 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.446679:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a620 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683518.446723:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789683518.446743:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a620 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.446768:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a619 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8af expref: 74 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.446852:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a620 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8af expref: 73 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.446861:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0f85396500) 00010000:00010000:1.0:1789683518.446863:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789683518.446868:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837daa00, rc 0) 00000100:00100000:1.0:1789683518.446942:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+73:12468:x1876618835499008:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 405us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683518.446955:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 241 00000100:00100000:2.0:1789683518.450241:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683518.450348:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835499136 00000100:00100000:3.0:1789683518.450358:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835499136 00000100:00100000:3.0:1789683518.450411:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:3.0:1789683518.450422:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+10:2402:x1876618835499136:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683518.450440:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683518.450471:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7def199/0xcf8485587b88a627 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc8b6 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683518.450498:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac673e, blocks: 0x0 00010000:00010000:3.0:1789683518.450521:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789683518.450525:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683518.450535:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7def199/0xcf8485587b88a627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8b6 expref: 11 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.450553:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e7def199/0xcf8485587b88a627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8b6 expref: 11 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.450568:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176600, rc 0) 00000100:00100000:3.0:1789683518.450635:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+11:2402:x1876618835499136:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 215us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683518.450642:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:1.0:1789683518.454422:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683518.454519:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835499392 00000100:00100000:2.0:1789683518.454531:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835499392 00000100:00100000:2.0:1789683518.454601:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 242 00000100:00100000:2.0:1789683518.454612:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+73:12468:x1876618835499392:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789683518.454739:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+73:12468:x1876618835499392:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 128us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683518.454747:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 242 00000100:00100000:1.0:1789683518.458350:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683518.458580:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835499520 00000100:00100000:2.0:1789683518.458590:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835499520 00000100:00100000:2.0:1789683518.458658:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 73 00000100:00100000:2.0:1789683518.458670:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+11:12468:x1876618835499520:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683518.458691:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683518.458710:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000783ae124/0xcf8485587b88a62e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc8bd expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.458745:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7def199/0xcf8485587b88a627 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8b6 expref: 12 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.458754:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683518.458758:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683518.458764:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000783ae124/0xcf8485587b88a62e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8bd expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.458864:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7def199/0xcf8485587b88a627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8b6 expref: 12 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.458878:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7def199/0xcf8485587b88a627 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8b6 expref: 12 pid: 8440 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683518.458893:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8437:1876618850227840:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683518.458983:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e836bd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683518.462643:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683518.462770:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8437:1876618850227840:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683518.462868:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000783ae124/0xcf8485587b88a62e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8bd expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.462892:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f8800, rc 0) 00000100:00100000:2.0:1789683518.462961:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+12:12468:x1876618835499520:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 4294us (4621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683518.462971:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 73 00000100:00100000:3.0:1789683518.463192:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835499648 00000100:00100000:3.0:1789683518.463200:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835499648 00010000:00010000:3.0:1789683518.463235:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7def199/0xcf8485587b88a627 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8b6 expref: 12 pid: 8440 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683518.463270:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 102 00000100:00100000:3.0:1789683518.463288:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+12:2403:x1876618835499648:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683518.463306:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683518.463330:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7def199/0xcf8485587b88a627 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8b6 expref: 12 pid: 8440 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.463364:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7def199/0xcf8485587b88a627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8b6 expref: 12 pid: 8440 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.463388:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7def199/0xcf8485587b88a627 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8b6 expref: 12 pid: 8440 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.463402:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683518.463637:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683518.463648:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000783ae124/0xcf8485587b88a62e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8bd expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.463659:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000783ae124/0xcf8485587b88a62e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8bd expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.463695:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000783ae124/0xcf8485587b88a62e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8bd expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683518.463710:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1876618850227968:192.168.201.50@tcp:105: 00000100:00100000:3.0:1789683518.463767:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc0775180 going to sleep for 11 seconds 00000100:00100000:3.0:1789683518.466688:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1876618850227968:192.168.201.50@tcp:105: 00010000:00010000:3.0:1789683518.466715:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683518.466764:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec036ece-1720-411a-849c-c978dbb41f8a+11:2403:x1876618835499648:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 3485us (4132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683518.466774:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 102 00000100:00100000:1.0:1789683518.469909:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683518.470026:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835499776 00000100:00100000:0.0:1789683518.470038:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835499776 00002000:00100000:0.0:1789683518.470109:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9f0e8451ed80 x1876618835499776/t0(0) o4->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:574/0 lens 504/0 e 0 to 0 dl 1789683529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789683518.470120:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e8451ed80 with x1876618835499776 ext(0->12) 00002000:00010000:0.0:1789683518.470142:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0e8451ed80 00000100:00100000:0.0:1789683518.470182:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:0.0:1789683518.470195:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec036ece-1720-411a-849c-c978dbb41f8a+11:2402:x1876618835499776:12345-192.168.201.50@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789683518.471385:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec036ece-1720-411a-849c-c978dbb41f8a+13:2402:x1876618835499776:12345-192.168.201.50@tcp:4:lhsmtool_posix.0 Request processed in 1186us (1481us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789683518.471395:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00002000:00100000:0.0:1789683518.471621:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9f0e8451ed80 x1876618835499776/t4294967322(0) o4->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:574/0 lens 504/448 e 0 to 0 dl 1789683529 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789683518.471632:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e8451ed80 with x1876618835499776 ext(0->12) 00002000:00010000:0.0:1789683518.471638:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0e8451ed80 00000100:00100000:1.0:1789683518.474197:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683518.474389:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835499904 00000100:00100000:0.0:1789683518.474400:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835499904 00000100:00100000:0.0:1789683518.474468:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 243 00000100:00100000:0.0:1789683518.474479:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+73:12468:x1876618835499904:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789683518.485581:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1789683518.485604:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1789683518.485653:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1789683518.485679:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f0f98fc3b40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789683518.485685:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0e83faa600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f0f98fc3d80 00000020:00080000:1.0:1789683518.485688:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0e83faac00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f0e83ee3200 00000004:00080000:1.0:1789683518.485713:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1789683518.485737:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f0f8c22a3c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789683518.485741:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0f857abd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f0f8c22acc0 00000020:00080000:1.0:1789683518.485744:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0f857ab700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f0f82ac9200 00000020:00080000:1.0:1789683518.485781:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1789683518.485881:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789683518.486090:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683518.486109:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850228096:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789683518.486176:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683518.486230:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850228096 00000100:00100000:3.0:1789683518.486238:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850228096 00000100:00100000:3.0:1789683518.486288:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789683518.486297:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3649:x1876618850228096:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789683518.486324:0:14000:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:3.0:1789683518.486357:0:14000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aac673d, atime: 0x6aac673d, ctime: 0x6aac673d, blocks: 0x8 00010000:00010000:3.0:1789683518.486365:0:14000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88a635 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.486381:0:14000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789683518.486385:0:14000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683518.486391:0:14000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88a635 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.486405:0:14000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88a635 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.486415:0:14000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88a635 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.486422:0:14000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88a635 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.486438:0:14000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789683518.486567:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3649:x1876618850228096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 271us (391us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789683518.486574:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1789683518.486592:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683518.486597:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88a635 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.486604:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683518.486609:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88a635 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.486617:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88a635 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.486633:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88a635 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.486641:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88a635 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.486658:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683518.486660:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683518.486662:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789683518.486690:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0f88c74e00/2, rc 0, transno 4294967311 00000100:00100000:3.0:1789683518.486695:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850228096:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789683518.487107:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850228352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789683518.487142:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683518.487163:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683518.487168:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850228224:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789683518.487188:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683518.487212:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850228352 00000100:00100000:2.0:1789683518.487217:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850228352 00000100:00100000:2.0:1789683518.487253:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850228224 00000100:00100000:2.0:1789683518.487257:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850228224 00000100:00100000:2.0:1789683518.487271:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789683518.487339:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1876618850228352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789683518.487434:0:8676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789683518.487437:0:8676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789683518 00002000:00010000:2.0:1789683518.487440:0:8676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789683518.487442:0:8676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789683518 -> 1789683518 00002000:00010000:2.0:1789683518.487445:0:8676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789683518.487476:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3648:x1876618850228352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 138us (332us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789683518.487482:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789683518.487496:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789683518.487502:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1876618850228224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789683518.487515:0:8676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1789683518.487529:0:8676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88a63c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.487546:0:8676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001185ae65/0xcf8485587b88a3e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc815 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.487555:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789683518.487560:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789683518.487564:0:8676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88a63c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.487592:0:8676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001185ae65/0xcf8485587b88a3e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc815 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.487613:0:8676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001185ae65/0xcf8485587b88a3e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc815 expref: 12 pid: 8437 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683518.487627:0:8676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1876618850228480:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683518.487692:0:8676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e836bd9c0 going to sleep for 11 seconds 00000004:00080000:2.0:1789683518.487722:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0fb7960380/2, rc 0, transno 4294967323 00000100:00100000:2.0:1789683518.487727:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850228352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789683518.490198:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+27:12468:x1876618835499904:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 Request processed in 15710us (16001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683518.490211:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 243 00010000:00010000:0.0:1789683518.491475:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a333 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491492:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a333 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491499:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a333 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491506:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683518.491511:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a333 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491541:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a333 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491557:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0e835a6a00) 00010000:00010000:0.0:1789683518.491560:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683518.491565:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a333 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491570:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88a333 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491600:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491607:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3db lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491613:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491618:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454cc00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683518.491621:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491627:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3db lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491635:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0fb8504a00) 00010000:00010000:0.0:1789683518.491636:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683518.491639:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3db lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491653:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454cc00/0xcf8485587b88a3db lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491680:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a459 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491686:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a459 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491692:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a459 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491697:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81391400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683518.491700:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a459 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491706:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a459 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491713:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0fb8504600) 00010000:00010000:0.0:1789683518.491715:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683518.491718:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a459 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491723:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81391400/0xcf8485587b88a459 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491734:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a47c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491740:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a47c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491749:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a47c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491754:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683518.491757:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a47c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491773:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a47c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491781:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0fb8504600) 00010000:00010000:0.0:1789683518.491800:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683518.491803:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a47c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491808:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88a47c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491832:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a54e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491837:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a54e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491842:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a54e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491847:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683518.491850:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a54e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491863:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a54e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491871:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:0.0:1789683518.491873:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683518.491876:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a54e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491881:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88a54e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491891:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a60b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491897:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a60b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491902:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a60b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491906:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683518.491908:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a60b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491914:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a60b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491920:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0f85396500) 00010000:00010000:0.0:1789683518.491922:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789683518.491925:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a60b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.491938:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a60b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.495260:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683518.502515:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683518.502629:0:8676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1876618850228480:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683518.502661:0:8676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88a63c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683518.502733:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835500032 00000100:00100000:3.0:1789683518.502740:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835500032 00000100:00100000:3.0:1789683518.502867:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 77 00000100:00100000:3.0:1789683518.502877:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+13:2402:x1876618835500032:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789683518.504706:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683518.504801:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835500160 00000100:00100000:3.0:1789683518.504810:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835500160 00010000:00010000:3.0:1789683518.504853:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001185ae65/0xcf8485587b88a3e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc815 expref: 14 pid: 8437 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683518.504897:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 103 00000100:00100000:3.0:1789683518.504906:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+14:2403:x1876618835500160:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683518.504919:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683518.504925:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001185ae65/0xcf8485587b88a3e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc815 expref: 14 pid: 8437 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.504939:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001185ae65/0xcf8485587b88a3e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc815 expref: 14 pid: 8437 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.504965:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001185ae65/0xcf8485587b88a3e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc815 expref: 14 pid: 8437 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.504985:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683518.504991:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683518.504998:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88a63c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.505008:0:10343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88a63c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.505215:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683518.505272:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+13:2403:x1876618835500160:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 366us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683518.505280:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 103 00000001:00080000:0.0:1789683518.506719:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1789683518.506733:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:3.0:1789683518.507001:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+7:2402:x1876618835500032:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 Request processed in 4120us (4492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683518.507011:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 77 00010000:00010000:2.0:1789683518.507643:0:8676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88a63c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.507658:0:8676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88a63c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.507670:0:8676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88a63c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.507700:0:8676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88a63c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.507757:0:8676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789683518.507976:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1876618850228224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20472us (20785us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789683518.507985:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789683518.508115:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1789683518.508122:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967319 committed transno 4294967323 00000004:00080000:0.0:1789683518.508159:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0fb7960380, transno 4294967323 00000100:00100000:0.0:1789683518.508180:0:3648:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9f0fb7961880 x1876618850228224/t4294967324(4294967324) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789683534 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789683518.508193:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0fb7961880/2, rc 0, transno 4294967324 00000100:00100000:0.0:1789683518.508198:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850228224:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789683518.508762:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683518.508775:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88a63c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.508806:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683518.508822:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88a63c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.508832:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88a63c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.508852:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88a63c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.508859:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062e0f7c5/0xcf8485587b88a63c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.508883:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683518.508892:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683518.508894:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683518.513972:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683518.514102:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835500416 00000100:00100000:2.0:1789683518.514125:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835500416 00000100:00100000:2.0:1789683518.514194:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 244 00000100:00100000:2.0:1789683518.514204:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+21:12468:x1876618835500416:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789683518.514268:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683518.514316:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a620 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8af expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.514340:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0f85396500) 00010000:00010000:2.0:1789683518.514346:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683518.514377:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a643 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.514392:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a643 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.514402:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a643 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683518.514541:0:8462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab9cd1fc reply state 0000000000981a56 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a643 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.514569:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a643 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.514575:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0f85396500) 00010000:00010000:2.0:1789683518.514578:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789683518.514581:0:8462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683518.514695:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+22:12468:x1876618835500416:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 491us (734us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1789683518.514703:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 244 00000100:00100000:1.0:1789683518.518394:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683518.518477:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835500544 00000100:00100000:3.0:1789683518.518490:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835500544 00000100:00100000:3.0:1789683518.518554:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 78 00000100:00100000:3.0:1789683518.518565:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+7:2403:x1876618835500544:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789683518.518736:0:14000:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789683518.518741:0:14000:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1789683518 -> 1789683518 00002000:00010000:3.0:1789683518.518744:0:14000:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789683517 00002000:00010000:3.0:1789683518.518746:0:14000:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789683518 -> 1789683518 00002000:00010000:3.0:1789683518.518749:0:14000:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789683518.518862:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+8:2403:x1876618835500544:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 298us (477us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1789683518.518871:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 78 00000100:00100000:1.0:1789683518.528327:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683518.528438:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835500800 00000100:00100000:2.0:1789683518.528450:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835500800 00000100:00100000:2.0:1789683518.528521:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 245 00000100:00100000:2.0:1789683518.528533:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+22:12468:x1876618835500800:12345-192.168.201.50@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789683518.528630:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a64a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.528650:0:12533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a604 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8a1 expref: 22 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.528661:0:12533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a64a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.528700:0:12533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a604 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8a1 expref: 22 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.528718:0:12533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a604 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8a1 expref: 22 pid: 8462 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683518.528752:0:12533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12533:1876618850228608:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683518.528884:0:12533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e836bd840 going to sleep for 11 seconds 00000100:00100000:2.0:1789683518.533999:0:12533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12533:1876618850228608:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683518.534031:0:12533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a64a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683518.535955:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683518.536086:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835500928 00000100:00100000:2.0:1789683518.536109:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835500928 00010000:00010000:2.0:1789683518.536167:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a604 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8a1 expref: 23 pid: 8462 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683518.536218:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 104 00000100:00100000:2.0:1789683518.536229:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+23:2403:x1876618835500928:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683518.536250:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683518.536258:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a604 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8a1 expref: 23 pid: 8462 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.536274:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a604 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8a1 expref: 23 pid: 8462 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.536309:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a604 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8a1 expref: 23 pid: 8462 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.536328:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0f85396500) 00010000:00010000:2.0:1789683518.536334:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a64a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.536351:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a64a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.536360:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a64a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.536396:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683518.536462:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+22:2403:x1876618835500928:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 224us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683518.536470:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 104 00010000:00010000:1.0:1789683518.537426:0:12533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a64a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.537439:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a64a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.537500:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a64a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.537508:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a64a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.537516:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a64a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.537523:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683518.537527:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a64a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.537536:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a64a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.537549:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0f85396500) 00010000:00010000:1.0:1789683518.537553:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789683518.537558:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a64a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.537565:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88a64a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683518.537628:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+21:12468:x1876618835500800:12345-192.168.201.50@tcp:55:lhsmtool_posix.0 Request processed in 9096us (9312us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789683518.537653:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 245 00000100:00100000:0.0:1789683518.546587:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683518.546688:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835501056 00000100:00100000:2.0:1789683518.546701:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835501056 00000100:00100000:2.0:1789683518.546769:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 79 00000100:00100000:2.0:1789683518.546780:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc1724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+8:2402:x1876618835501056:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789683518.546871:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88a651 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.546893:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000783ae124/0xcf8485587b88a62e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8bd expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.546902:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683518.546907:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789683518.546911:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88a651 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.546948:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000783ae124/0xcf8485587b88a62e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8bd expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.546979:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000783ae124/0xcf8485587b88a62e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8bd expref: 8 pid: 8437 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683518.546995:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8437:1876618850228736:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683518.547082:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e836bd840 going to sleep for 11 seconds 00000100:00100000:2.0:1789683518.551992:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8437:1876618850228736:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683518.552032:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88a651 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683518.557272:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683518.557601:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835501184 00000100:00100000:1.0:1789683518.557613:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835501184 00010000:00010000:1.0:1789683518.557662:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000783ae124/0xcf8485587b88a62e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8bd expref: 9 pid: 8437 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683518.557706:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 105 00000100:00100000:1.0:1789683518.557718:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+9:2403:x1876618835501184:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683518.557734:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683518.557758:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000783ae124/0xcf8485587b88a62e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8bd expref: 9 pid: 8437 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.557771:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000783ae124/0xcf8485587b88a62e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8bd expref: 9 pid: 8437 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.557843:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000783ae124/0xcf8485587b88a62e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8bd expref: 9 pid: 8437 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.557866:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789683518.557871:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789683518.557877:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88a651 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.557888:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88a651 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.557947:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683518.558017:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec036ece-1720-411a-849c-c978dbb41f8a+8:2403:x1876618835501184:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 300us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683518.558025:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 105 00010000:00010000:2.0:1789683518.558690:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88a651 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.558703:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88a651 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.558727:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88a651 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.558734:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88a651 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.558741:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88a651 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.558764:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683518.558768:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88a651 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.558778:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88a651 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.558828:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88a651 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.558836:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001dd15dc2/0xcf8485587b88a651 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683518.558975:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc1724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec036ece-1720-411a-849c-c978dbb41f8a+7:2402:x1876618835501056:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 Request processed in 12194us (12395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683518.558985:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 79 00000100:00100000:1.0:1789683518.576413:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683518.578939:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835501440 00000100:00100000:2.0:1789683518.578957:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835501440 00000100:00100000:2.0:1789683518.579080:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 246 00000100:00100000:2.0:1789683518.579091:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+21:12468:x1876618835501440:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789683518.579185:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a658 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.579204:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a547 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc869 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.579231:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a658 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.579266:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a547 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc869 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.579293:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a547 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc869 expref: 21 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683518.579310:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850228864:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683518.579409:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e836bd840 going to sleep for 11 seconds 00000100:00100000:0.0:1789683518.581921:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683518.586441:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835501568 00000100:00100000:3.0:1789683518.586456:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835501568 00010000:00010000:3.0:1789683518.586502:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a547 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc869 expref: 22 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683518.586554:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 106 00000100:00100000:3.0:1789683518.586563:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+22:2402:x1876618835501568:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683518.586577:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683518.586583:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a547 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc869 expref: 22 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.586595:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a547 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc869 expref: 22 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.586633:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:3.0:1789683518.586639:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b88a5a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc88c expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.586649:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a658 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.586657:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.586664:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a658 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.586681:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683518.586742:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+22:2402:x1876618835501568:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 180us (4832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683518.586749:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 106 00010000:00010000:2.0:1789683518.587173:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c600/0xcf8485587b88a547 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc869 expref: 21 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683518.587192:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850228864:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683518.587215:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.587225:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.587232:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.587415:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a65f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.587429:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a612 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8a8 expref: 21 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.587445:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a65f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.587490:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a612 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8a8 expref: 21 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.587505:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a612 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8a8 expref: 21 pid: 12533 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683518.587521:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850228992:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683518.587578:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e836bd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683518.590928:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683518.591138:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835501696 00000100:00100000:3.0:1789683518.591149:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835501696 00010000:00010000:3.0:1789683518.591194:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a612 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8a8 expref: 22 pid: 12533 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683518.591242:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 107 00000100:00100000:3.0:1789683518.591252:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84447c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+22:2402:x1876618835501696:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683518.591268:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683518.591285:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a612 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8a8 expref: 22 pid: 12533 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.591320:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a612 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8a8 expref: 22 pid: 12533 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.591342:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0f85396500) 00010000:00010000:3.0:1789683518.591347:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a65f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.591357:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a65f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.591365:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a65f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.591384:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683518.591432:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84447c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+22:2402:x1876618835501696:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 181us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683518.591440:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 107 00010000:00010000:2.0:1789683518.592246:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a612 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8a8 expref: 21 pid: 12533 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683518.592267:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850228992:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683518.592297:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a65f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.592306:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a65f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.592313:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a65f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789683518.592423:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1789683518.592558:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1789683518.592592:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1789683518.592677:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876618850229120:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789683518.592729:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683518.592752:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f845d3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683518.593678:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850229120 00000100:00100000:0.0:1789683518.593688:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850229120 00000100:00100000:0.0:1789683518.593748:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789683518.593757:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1876618850229120:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789683518.593894:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1876618850229120:12345-0@lo:1000:mdt00_000.0 Request processed in 137us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683518.593902:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789683518.594091:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876618850229120:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789683518.594234:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1789683518.594307:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c75880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876618850229248:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789683518.594342:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683518.594362:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789683518.594757:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850229248 00000100:00100000:2.0:1789683518.594763:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850229248 00000100:00100000:2.0:1789683518.594824:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789683518.594833:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6521:x1876618850229248:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789683518.594943:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6521:x1876618850229248:12345-0@lo:1000:mdt00_000.0 Request processed in 111us (600us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1789683518.594951:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789683518.595057:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c75880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876618850229248:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789683518.595104:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a65f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.595114:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a65f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.595135:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a65f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.595141:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683518.595146:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a65f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.595154:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a65f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.595169:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0f85396500) 00010000:00010000:3.0:1789683518.595172:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789683518.595177:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a65f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.595184:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a65f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.595207:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8000/0xcf8485587b88a5a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.595215:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8000/0xcf8485587b88a5a2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.595222:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8000/0xcf8485587b88a5a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.595227:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683518.595231:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8000/0xcf8485587b88a5a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.595247:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8000/0xcf8485587b88a5a2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.595256:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:3.0:1789683518.595259:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789683518.595266:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b88a5a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc88c expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.595399:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b88a5a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc88c expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.595409:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b88a5a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc88c expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.595438:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b88a5a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc88c expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683518.595654:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850229376:192.168.201.50@tcp:105: 00000100:00100000:3.0:1789683518.595738:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e8373e000 going to sleep for 11 seconds 00000100:00100000:3.0:1789683518.598686:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876618850229376:192.168.201.50@tcp:105: 00010000:00010000:3.0:1789683518.598721:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8000/0xcf8485587b88a5a2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.598733:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8000/0xcf8485587b88a5a2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.598764:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a666 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.598834:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a666 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.598846:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a666 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.598858:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a666 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.598864:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a666 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.598870:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a666 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.598875:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683518.598878:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a666 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.598885:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a666 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.598895:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:3.0:1789683518.598898:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683518.598901:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a666 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.598906:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176c00/0xcf8485587b88a666 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.598915:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.598925:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a658 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.598930:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a658 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.598935:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683518.598937:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a658 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.598941:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a658 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.598948:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:3.0:1789683518.598950:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789683518.598952:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a658 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.598957:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8200/0xcf8485587b88a658 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683518.599136:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+24:12468:x1876618835501440:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 20046us (22734us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1789683518.599146:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 246 00000020:00080000:3.0:1789683518.599151:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789683518.599358:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789683518.599364:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789683518.599894:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789683518.599912:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789683518.604206:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683518.604655:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835501952 00000100:00100000:3.0:1789683518.604667:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835501952 00000100:00100000:3.0:1789683518.604730:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:3.0:1789683518.604741:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+24:12468:x1876618835501952:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789683518.605113:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789683518.605150:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1789683518.605183:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a66d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.605201:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a66d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.605213:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a66d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.605223:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a66d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.605230:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a66d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.605237:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a66d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.605257:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789683518.605363:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+26:12468:x1876618835501952:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 623us (1171us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789683518.605371:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 61 00000020:00080000:3.0:1789683518.605376:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789683518.606135:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683518.606146:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a66d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.606154:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683518.606158:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a66d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.606166:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a66d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.606181:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0f85396500) 00010000:00010000:0.0:1789683518.606185:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789683518.606190:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a66d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.606196:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88a66d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.606210:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683518.606212:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683518.606213:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683518.609827:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683518.610013:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835502080 00000100:00100000:3.0:1789683518.610028:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835502080 00000100:00100000:3.0:1789683518.610087:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 62 00000100:00100000:3.0:1789683518.610098:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f867cb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+26:12467:x1876618835502080:12345-192.168.201.50@tcp:49:lfs.0 00000100:00100000:3.0:1789683518.610262:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f867cb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+26:12467:x1876618835502080:12345-192.168.201.50@tcp:49:lfs.0 Request processed in 166us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683518.610293:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 62 00000100:00100000:2.0:1789683518.616061:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683518.616224:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835502336 00000100:00100000:0.0:1789683518.616236:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835502336 00000100:00100000:0.0:1789683518.616309:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 247 00000100:00100000:0.0:1789683518.616320:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+26:12467:x1876618835502336:12345-192.168.201.50@tcp:58:lfs.0 00000040:00080000:0.0:1789683518.616535:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1789683518.616637:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+26:12467:x1876618835502336:12345-192.168.201.50@tcp:58:lfs.0 Request processed in 317us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683518.616646:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 247 00000100:00100000:0.0:1789683518.648263:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683518.648984:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835502464 00000100:00100000:1.0:1789683518.648998:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835502464 00000100:00100000:1.0:1789683518.649140:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 248 00000100:00100000:1.0:1789683518.649153:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+26:12470:x1876618835502464:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789683518.649177:0:12533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683518.649201:0:12533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a674 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc8c4 expref: -99 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.649404:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a67b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.649421:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a67b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.649435:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a67b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.649471:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a682 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.649479:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.649502:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.649583:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a689 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.649594:0:12533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88a594 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc885 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.649603:0:12533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a689 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.649638:0:12533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88a594 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc885 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.649654:0:12533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88a594 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc885 expref: 27 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683518.649668:0:12533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12533:1876618850229504:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789683518.649769:0:12533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f90530480 going to sleep for 11 seconds 00000100:00100000:1.0:1789683518.653959:0:12533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12533:1876618850229504:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789683518.654001:0:12533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a689 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683518.658940:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683518.659227:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835502720 00000100:00100000:3.0:1789683518.659241:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835502720 00000100:00100000:3.0:1789683518.659314:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:3.0:1789683518.659325:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+28:6173:x1876618835502720:12345-192.168.201.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789683518.659575:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+29:6173:x1876618835502720:12345-192.168.201.50@tcp:35:ldlm_bl.0 Request processed in 252us (645us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1789683518.659583:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:3.0:1789683518.670625:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683518.670930:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835502848 00000100:00100000:2.0:1789683518.670942:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835502848 00010000:00010000:2.0:1789683518.670989:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88a594 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc885 expref: 29 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683518.671024:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 108 00000100:00100000:2.0:1789683518.671036:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+29:2402:x1876618835502848:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683518.671056:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683518.671064:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88a594 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc885 expref: 29 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.671079:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88a594 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc885 expref: 29 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.671118:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88a594 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc885 expref: 29 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.671158:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:2.0:1789683518.671164:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a689 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.671174:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.671182:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a689 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.671216:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683518.671284:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec036ece-1720-411a-849c-c978dbb41f8a+28:2402:x1876618835502848:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 250us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683518.671291:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 108 00010000:00010000:1.0:1789683518.672634:0:12533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.672649:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683518.672716:0:12533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789683518.672720:0:12533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789683518.672743:0:12533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.672758:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.672769:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a67b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.672776:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a67b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.672827:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a67b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.672835:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837db600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683518.672839:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a67b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.672847:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a67b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.672860:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:1.0:1789683518.672863:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683518.672867:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a67b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.672874:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a67b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.672899:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.672905:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a682 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.672911:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a682 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.672916:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dac00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683518.672919:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a682 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.672924:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a682 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.672931:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0fb8504f00) 00010000:00010000:1.0:1789683518.672934:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683518.672937:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a682 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.672942:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dac00/0xcf8485587b88a682 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.672982:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88a674 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8c4 expref: 28 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.672996:0:12533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a689 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8c4 expref: 27 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.673016:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:1.0:1789683518.673019:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683518.673022:0:12533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837daa00, rc 0) 00000100:00100000:1.0:1789683518.673082:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+27:12470:x1876618835502464:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 23932us (24828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683518.673089:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 248 00010000:00010000:3.0:1789683519.519068:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683519.591001:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683519.591030:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850229632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683519.591125:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683519.591211:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850229632 00000100:00100000:1.0:1789683519.591220:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850229632 00000100:00100000:1.0:1789683519.591717:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789683519.591729:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850229632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789683519.591764:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683519.591861:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850229632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 134us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683519.591868:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789683519.593135:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850229632:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789683519.599880:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1789683519.652748:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789683519.652756:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789683519.652777:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789683519.652809:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789683519.652944:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaf100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1876618850229760:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789683519.653057:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e92e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789683519.665413:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683519.665528:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835502976 00000100:00100000:3.0:1789683519.665540:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835502976 00000100:00100000:3.0:1789683519.665620:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 249 00000100:00100000:3.0:1789683519.665632:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+28:12481:x1876618835502976:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789683519.665679:0:6521:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789683519.665864:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+28:12481:x1876618835502976:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 234us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683519.665872:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 249 00000100:00080000:1.0:1789683519.668615:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683519.669889:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaf100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1876618850229760:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789683519.671488:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683519.671530:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835503232 00000100:00100000:1.0:1789683519.671541:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835503232 00000100:00100000:1.0:1789683519.671599:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 250 00000100:00100000:1.0:1789683519.671610:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+27:12481:x1876618835503232:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789683519.671647:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683519.671674:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a690 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc8cb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683519.671824:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a697 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683519.671844:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683519.671857:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683519.671870:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789683519.671990:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a690 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8cb expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683519.672007:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a697 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8cb expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683519.672016:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:1.0:1789683519.672019:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683519.672023:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837db600, rc 0) 00000100:00100000:1.0:1789683519.672082:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec036ece-1720-411a-849c-c978dbb41f8a+29:12481:x1876618835503232:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 474us (603us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789683519.672090:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 250 00000100:00100000:3.0:1789683519.680424:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683519.680557:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835503488 00000100:00100000:1.0:1789683519.680569:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835503488 00000100:00100000:1.0:1789683519.680631:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 251 00000100:00100000:1.0:1789683519.680653:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+29:12481:x1876618835503488:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789683519.680740:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a6a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683519.680757:0:12533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683519.680770:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683519.680996:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683519.681005:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a6a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683519.681013:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a6a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683519.681020:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837da200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683519.681024:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a6a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683519.681032:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a6a5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683519.681044:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:1.0:1789683519.681047:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789683519.681052:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a6a5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683519.681059:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da200/0xcf8485587b88a6a5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683519.681179:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+30:12481:x1876618835503488:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 527us (766us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789683519.681187:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 251 00000040:00080000:1.0:1789683519.681365:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683519.681370:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683519.681960:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789683519.681970:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789683519.684765:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683519.685096:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835503616 00000100:00100000:3.0:1789683519.685107:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835503616 00000100:00100000:3.0:1789683519.685305:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:3.0:1789683519.685316:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+30:2404:x1876618835503616:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683519.685350:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683519.685380:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db600/0xcf8485587b88a697 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8cb expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683519.685506:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:3.0:1789683519.685512:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683519.685571:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec036ece-1720-411a-849c-c978dbb41f8a+29:2404:x1876618835503616:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 257us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683519.685579:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:2.0:1789683519.689732:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683519.690763:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835503872 00000100:00100000:2.0:1789683519.690777:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835503872 00000100:00100000:2.0:1789683519.690873:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:2.0:1789683519.690885:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+29:12481:x1876618835503872:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789683519.691154:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+30:12481:x1876618835503872:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 269us (1434us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789683519.691162:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 64 00000040:00080000:1.0:1789683519.728251:0:14817:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683519.728918:0:14817:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683519.728959:0:14817:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789683519.728968:0:14817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789683519.883503:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683519.883587:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835504128 00000100:00100000:2.0:1789683519.883598:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835504128 00000100:00100000:2.0:1789683519.883657:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 252 00000100:00100000:2.0:1789683519.883668:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+30:12494:x1876618835504128:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683519.883713:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683519.883736:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a6ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc8d2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683519.883902:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8000/0xcf8485587b88a6b3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683519.883919:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8000/0xcf8485587b88a6b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683519.883933:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8000/0xcf8485587b88a6b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683519.883946:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789683519.884046:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a6ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8d2 expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683519.884063:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8000/0xcf8485587b88a6b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8d2 expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683519.884212:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:2.0:1789683519.884217:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789683519.884221:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f8000, rc 0) 00000100:00100000:2.0:1789683519.884299:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+32:12494:x1876618835504128:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 632us (802us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789683519.884306:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 252 00000100:00100000:0.0:1789683519.890611:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683519.892288:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835504256 00000100:00100000:2.0:1789683519.892302:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835504256 00000100:00100000:2.0:1789683519.892425:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 253 00000100:00100000:2.0:1789683519.892444:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+32:12494:x1876618835504256:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:2.0:1789683519.892531:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a6c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683519.892550:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683519.892563:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683519.892599:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683519.892607:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a6c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683519.892614:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683519.892620:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683519.892624:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683519.892632:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a6c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683519.892643:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:2.0:1789683519.892647:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789683519.892652:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a6c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683519.892658:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88a6c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683519.892742:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+32:12494:x1876618835504256:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 301us (2142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683519.892749:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 253 00000100:00100000:0.0:1789683519.979242:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683519.979367:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835504384 00000100:00100000:2.0:1789683519.979379:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835504384 00000100:00100000:2.0:1789683519.979504:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 80 00000100:00100000:2.0:1789683519.979518:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec036ece-1720-411a-849c-c978dbb41f8a+7:2403:x1876618835504384:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:2.0:1789683519.979540:0:8676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683519.979564:0:8676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000783ae124/0xcf8485587b88a6c8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc8d9 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789683519.979594:0:8676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aac673e, atime: 0x6aac673d, ctime: 0x6aac673e, blocks: 0x8 00010000:00010000:2.0:1789683519.979620:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1789683519.979625:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683519.979636:0:8676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000783ae124/0xcf8485587b88a6c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8d9 expref: 8 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683519.979657:0:8676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000783ae124/0xcf8485587b88a6c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8d9 expref: 8 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683519.979672:0:8676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f8800, rc 0) 00000100:00100000:2.0:1789683519.979739:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec036ece-1720-411a-849c-c978dbb41f8a+8:2403:x1876618835504384:12345-192.168.201.50@tcp:101:cat.0 Request processed in 224us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683519.979747:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 80 00000100:00080000:1.0:1789683519.980367:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683519.983709:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683519.983879:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835504512 00000100:00100000:1.0:1789683519.983891:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835504512 00002000:00100000:1.0:1789683519.983954:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9f0e83ead500 x1876618835504512/t0(0) o3->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:575/0 lens 488/0 e 0 to 0 dl 1789683530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789683519.983970:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e83ead500 with x1876618835504512 ext(0->4095) 00002000:00010000:1.0:1789683519.983978:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0e83ead500 00000100:00100000:1.0:1789683519.984021:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:1.0:1789683519.984033:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec036ece-1720-411a-849c-c978dbb41f8a+8:2404:x1876618835504512:12345-192.168.201.50@tcp:3:cat.0 00000100:00100000:1.0:1789683519.984361:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec036ece-1720-411a-849c-c978dbb41f8a+8:2404:x1876618835504512:12345-192.168.201.50@tcp:3:cat.0 Request processed in 328us (661us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789683519.984369:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 8 00002000:00100000:1.0:1789683519.984376:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9f0e83ead500 x1876618835504512/t0(0) o3->ec036ece-1720-411a-849c-c978dbb41f8a@192.168.201.50@tcp:575/0 lens 488/4536 e 0 to 0 dl 1789683530 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789683519.984404:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0e83ead500 with x1876618835504512 ext(0->4095) 00002000:00010000:1.0:1789683519.984407:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0e83ead500 00000100:00100000:3.0:1789683520.095581:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850229888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683520.095650:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683520.095755:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850229888 00000100:00100000:1.0:1789683520.095764:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850229888 00000100:00100000:1.0:1789683520.095874:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789683520.095885:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1876618850229888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789683520.095909:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789683520.096165:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683520.109896:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1876618850229888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 13997us (14229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683520.109919:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789683520.110139:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850229888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683520.110177:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683520.110189:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850230272:0@lo:400:kworker.0 00000100:00100000:3.0:1789683520.110277:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683520.110688:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850230272 00000100:00100000:1.0:1789683520.110697:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850230272 00000100:00100000:1.0:1789683520.110753:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789683520.110762:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850230272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683520.110914:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850230016:0@lo:400:kworker.0 00000100:00100000:3.0:1789683520.110951:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683520.110977:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683520.110984:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850230144:0@lo:400:kworker.0 00000100:00100000:3.0:1789683520.111009:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683520.111198:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850230144 00000100:00100000:3.0:1789683520.111202:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850230144 00000100:00100000:3.0:1789683520.111236:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1789683520.111243:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850230144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683520.111298:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850230144:12345-0@lo:400:kworker.0 Request processed in 55us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683520.111325:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789683520.111584:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850230016 00000100:00100000:0.0:1789683520.111590:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850230016 00000100:00100000:0.0:1789683520.111624:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1789683520.111631:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850230016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683520.111698:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850230144:0@lo:400:kworker.0 00000100:00100000:0.0:1789683520.112318:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850230016:12345-0@lo:400:kworker.0 Request processed in 685us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683520.112327:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1789683520.112383:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850230016:0@lo:400:kworker.0 00000100:00100000:2.0:1789683520.112870:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683520.112894:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850230528:0@lo:400:kworker.0 00000100:00100000:2.0:1789683520.112935:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683520.112982:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850230656:0@lo:400:kworker.0 00000100:00100000:2.0:1789683520.113006:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683520.113033:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850230656 00000100:00100000:2.0:1789683520.113037:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850230656 00000100:00100000:0.0:1789683520.116120:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850230528 00000100:00100000:0.0:1789683520.116142:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850230528 00000100:00100000:0.0:1789683520.116219:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789683520.116231:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850230528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683520.116377:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850230528:12345-0@lo:400:kworker.0 Request processed in 148us (3441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683520.116384:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789683520.116410:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683520.116426:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850230400:0@lo:400:kworker.0 00000100:00100000:0.0:1789683520.116719:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789683520.116771:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683520.116857:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850230400 00000100:00100000:0.0:1789683520.116862:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850230400 00000100:00100000:0.0:1789683520.116892:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789683520.116900:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850230656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683520.116941:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850230656:12345-0@lo:400:kworker.0 Request processed in 42us (3934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683520.116947:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789683520.116962:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789683520.116967:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850230400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683520.117006:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850230400:12345-0@lo:400:kworker.0 Request processed in 40us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683520.117011:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789683520.117047:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850230400:0@lo:400:kworker.0 00000100:00100000:2.0:1789683520.117238:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850230656:0@lo:400:kworker.0 00000100:00100000:2.0:1789683520.117263:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850230528:0@lo:400:kworker.0 00000100:00100000:2.0:1789683520.117331:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683520.117338:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850231040:0@lo:400:kworker.0 00000100:00100000:2.0:1789683520.125628:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683520.125745:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850231168:0@lo:400:kworker.0 00000100:00100000:2.0:1789683520.125778:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683520.125843:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850231168 00000100:00100000:2.0:1789683520.125851:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850231168 00000100:00100000:2.0:1789683520.125912:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789683520.125921:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850231168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683520.125978:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850231168:12345-0@lo:400:kworker.0 Request processed in 59us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683520.125986:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789683520.126028:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850231168:0@lo:400:kworker.0 00000100:00080000:2.0:1789683520.126052:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683520.126223:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850230784:0@lo:400:kworker.0 00000100:00100000:0.0:1789683520.126270:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683520.126301:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683520.126309:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850230912:0@lo:400:kworker.0 00000100:00100000:0.0:1789683520.126329:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683520.126511:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850231040 00000100:00100000:0.0:1789683520.126516:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850231040 00000100:00100000:0.0:1789683520.126551:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850230912 00000100:00100000:0.0:1789683520.126554:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850230912 00000100:00100000:0.0:1789683520.126574:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789683520.126581:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1876618850231040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683520.126619:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1876618850231040:12345-0@lo:400:kworker.0 Request processed in 38us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683520.126625:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789683520.126638:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789683520.126645:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850230912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683520.126673:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850230912:12345-0@lo:400:kworker.0 Request processed in 29us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683520.126679:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789683520.126815:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850230912:0@lo:400:kworker.0 00000100:00100000:2.0:1789683520.127196:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850230784 00000100:00100000:2.0:1789683520.127201:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850230784 00000100:00100000:2.0:1789683520.127231:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789683520.127238:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850230784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683520.127345:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850231296:0@lo:400:kworker.0 00000100:00100000:2.0:1789683520.127547:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850230784:12345-0@lo:400:kworker.0 Request processed in 309us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683520.127555:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789683520.127605:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850231040:0@lo:400:kworker.0 00000100:00080000:2.0:1789683520.127629:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789683520.127633:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683520.128219:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789683520.128273:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7961c00 x1876618850230784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683520.128286:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850230784:0@lo:400:kworker.0 00000100:00100000:0.0:1789683520.128300:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683520.128307:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850231424:0@lo:400:kworker.0 00000100:00100000:0.0:1789683520.128332:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683520.128507:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850231424 00000100:00100000:0.0:1789683520.128514:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850231424 00000100:00100000:0.0:1789683520.128553:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789683520.128572:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850231424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683520.128615:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850231424:12345-0@lo:400:kworker.0 Request processed in 45us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683520.128621:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789683520.128653:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850231424:0@lo:400:kworker.0 00000100:00100000:1.0:1789683520.129003:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850230272:12345-0@lo:400:kworker.0 Request processed in 18240us (18724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683520.129012:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789683520.130403:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850231296 00000100:00100000:2.0:1789683520.130415:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850231296 00000100:00100000:2.0:1789683520.130503:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789683520.130511:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850231296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683520.130594:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850231296:12345-0@lo:400:kworker.0 Request processed in 84us (2375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683520.130600:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00080000:0.0:1789683520.132214:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789683520.132287:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7960a80 x1876618850231296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683520.132307:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850231296:0@lo:400:kworker.0 00000100:00100000:3.0:1789683520.136028:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850230272:0@lo:400:kworker.0 00010000:00010000:1.0:1789683520.544952:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683521.575573:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683522.072888:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683522.073023:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683522.073055:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683522.073084:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683522.073104:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683522.073123:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683522.073144:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683522.073172:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835504896 00000100:00100000:1.0:1789683522.073182:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835504896 00000100:00100000:2.0:1789683522.073209:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835504640 00000100:00100000:2.0:1789683522.073224:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835504640 00000100:00100000:1.0:1789683522.073259:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835505408 00000100:00100000:1.0:1789683522.073262:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835505408 00000100:00100000:2.0:1789683522.073264:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 397 00000100:00100000:2.0:1789683522.073274:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:2405:x1876618835504640:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683522.073274:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835504768 00000100:00100000:1.0:1789683522.073276:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835504768 00000100:00100000:1.0:1789683522.073302:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835505280 00000100:00100000:1.0:1789683522.073304:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835505280 00000100:00100000:1.0:1789683522.073329:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 339 00000100:00100000:1.0:1789683522.073336:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835504896:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683522.073356:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea7031b9-febc-4826-a965-62f420153ef7+13:2405:x1876618835504640:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 83us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683522.073363:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 397 00000100:00100000:1.0:1789683522.073367:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835504896:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 33us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683522.073482:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835505152 00000100:00100000:3.0:1789683522.073487:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835505152 00000100:00100000:3.0:1789683522.073514:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835505024 00000100:00100000:3.0:1789683522.073517:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835505024 00000100:00100000:2.0:1789683522.073526:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 135 00000100:00100000:2.0:1789683522.073533:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835505152:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683522.073567:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2405:x1876618835505152:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 34us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683522.073584:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 339 00000100:00100000:3.0:1789683522.074714:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 136 00000100:00100000:3.0:1789683522.074727:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+8:2405:x1876618835505024:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683522.074781:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+8:2405:x1876618835505024:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 58us (1656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683522.074800:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 136 00000100:00100000:0.0:1789683522.078870:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 340 00000100:00100000:0.0:1789683522.078904:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835505408:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683522.079000:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835505408:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 116us (5916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683522.079008:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 340 00000100:00100000:0.0:1789683522.079048:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 341 00000100:00100000:0.0:1789683522.079056:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+32:2405:x1876618835504768:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683522.079084:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+32:2405:x1876618835504768:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 30us (5981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683522.079090:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 341 00000100:00100000:0.0:1789683522.079104:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 342 00000100:00100000:0.0:1789683522.079111:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835505280:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683522.079162:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13ee1651-c170-427a-b389-1f9d341ed790+5:2405:x1876618835505280:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 51us (6016us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683522.079168:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 342 00000100:00080000:1.0:1789683522.081902:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683522.081916:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789683522.081921:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683522.081925:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789683522.083701:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 135 00000100:00100000:3.0:1789683522.149341:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850231552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683522.149434:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683522.149604:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850231552 00000100:00100000:0.0:1789683522.149612:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850231552 00000100:00100000:0.0:1789683522.149666:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789683522.149676:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850231552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789683522.149713:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789683522.149775:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850231552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683522.149804:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789683522.149899:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850231552:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789683522.597122:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789683522.599159:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:0.0:1789683522.663316:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:2.0:1789683522.665949:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850231680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683522.666027:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683522.666281:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850231680 00000100:00100000:1.0:1789683522.666291:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850231680 00000100:00100000:1.0:1789683522.666360:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789683522.666370:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850231680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789683522.666410:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789683522.666469:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850231680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683522.666477:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789683522.666536:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850231680:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789683522.666590:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1789683522.789959:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789683522.789969:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789683522.789992:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789683522.790001:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789683523.167042:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683523.167202:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850231808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683523.167263:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683523.167288:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683523.167288:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850231936:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683523.167358:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850231808 00000100:00100000:1.0:1789683523.167367:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850231808 00000100:00100000:1.0:1789683523.167462:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1789683523.167500:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683523.167651:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1876618850231808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683523.167681:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789683523.169166:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683523.169298:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850231936 00000100:00100000:1.0:1789683523.169306:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850231936 00000100:00100000:1.0:1789683523.169429:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789683523.169443:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850231936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683523.169489:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789683523.169890:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1876618850231808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2418us (2603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683523.169900:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789683523.170008:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850231808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683523.173138:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850231936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3690us (3967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683523.173153:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789683523.173351:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850231936:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789683523.618925:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789683523.683860:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1789683523.683893:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f0e836bda80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1789683523.683898:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0e83faa400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f0fc0775a80 00000020:00080000:1.0:1789683523.683902:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0e83faa900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f0e83f67200 00000020:00080000:1.0:1789683523.683921:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1789683523.683933:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789683523.683993:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1789683523.684115:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a643 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683523.684144:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a643 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683523.684151:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a643 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683523.684157:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683523.684162:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a643 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683523.684171:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a643 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683523.684196:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0f85396500) 00010000:00010000:3.0:1789683523.684199:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683523.684204:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a643 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683523.684211:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a643 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789683523.689460:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00000001:00080000:0.0:1789683523.689478:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00010000:00010000:1.0:1789683524.649177:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683524.703200:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683524.703232:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850232064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683524.703328:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683524.703674:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850232064 00000100:00100000:1.0:1789683524.703684:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850232064 00000100:00100000:1.0:1789683524.703773:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789683524.703816:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850232064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789683524.703850:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683524.703904:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850232064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683524.703911:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789683524.703969:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850232064:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789683524.704090:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683524.746901:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683524.747007:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835505536 00000100:00100000:0.0:1789683524.747021:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835505536 00000100:00100000:0.0:1789683524.747117:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 254 00000100:00100000:0.0:1789683524.747129:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+18:12148:x1876618835505536:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789683524.747271:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+18:12148:x1876618835505536:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 Request processed in 145us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683524.747296:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 254 00000100:00080000:3.0:1789683524.748020:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683524.757902:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683524.758007:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835505664 00000100:00100000:1.0:1789683524.758028:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835505664 00000100:00100000:1.0:1789683524.758102:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 255 00000100:00080000:3.0:1789683524.758107:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683524.758114:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:12148:x1876618835505664:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789683524.758235:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:12148:x1876618835505664:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 Request processed in 124us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683524.758243:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 255 00000100:00100000:2.0:1789683524.764875:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683524.773164:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835505920 00000100:00100000:3.0:1789683524.773186:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835505920 00000100:00100000:3.0:1789683524.773279:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:3.0:1789683524.773292:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+18:12148:x1876618835505920:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789683524.773593:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+19:12148:x1876618835505920:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 303us (8729us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789683524.773618:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:2.0:1789683525.216325:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850232320:0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.216409:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683525.216495:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850232832:0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.216520:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683525.216539:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850233344:0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.216560:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683525.216583:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850233856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683525.216610:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683525.216640:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789683525.216646:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850232448:0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.216669:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683525.216683:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850232960:0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.216729:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683525.216744:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850233472:0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.216760:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683525.216814:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850232576:0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.216836:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683525.216851:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850233088:0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.216869:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683525.216883:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850233600:0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.216899:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683525.216915:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789683525.216921:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850232192:0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.216950:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683525.216968:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850232704:0@lo:400:kworker.0 00000100:00100000:0.0:1789683525.217129:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850233088 00000100:00100000:0.0:1789683525.217137:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850233088 00000100:00100000:0.0:1789683525.217197:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850233600 00000100:00100000:0.0:1789683525.217200:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850233600 00000100:00100000:0.0:1789683525.217223:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789683525.217231:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850233088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683525.217289:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850233088:12345-0@lo:400:kworker.0 Request processed in 58us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683525.217296:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789683525.217313:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789683525.217319:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850233600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683525.217345:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850233600:12345-0@lo:400:kworker.0 Request processed in 27us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683525.217350:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789683525.217367:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850232192 00000100:00100000:0.0:1789683525.217370:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850232192 00000100:00100000:0.0:1789683525.217394:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1789683525.217401:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850232192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683525.217428:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850232192:12345-0@lo:400:kworker.0 Request processed in 28us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683525.217434:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1789683525.217478:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850232320 00000100:00100000:0.0:1789683525.217482:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850232320 00000100:00100000:0.0:1789683525.217498:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850232832 00000100:00100000:0.0:1789683525.217509:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850232832 00000100:00100000:0.0:1789683525.217524:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850233344 00000100:00100000:0.0:1789683525.217526:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850233344 00000100:00100000:0.0:1789683525.217535:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850232960 00000100:00100000:0.0:1789683525.217537:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850232960 00000100:00100000:0.0:1789683525.217548:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850233472 00000100:00100000:0.0:1789683525.217550:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850233472 00000100:00100000:0.0:1789683525.217560:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850232576 00000100:00100000:0.0:1789683525.217562:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850232576 00000100:00100000:0.0:1789683525.217574:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789683525.217579:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850232320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683525.217619:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850232320:12345-0@lo:400:kworker.0 Request processed in 39us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683525.217624:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789683525.217636:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789683525.217642:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850232832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683525.217669:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850232832:12345-0@lo:400:kworker.0 Request processed in 27us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683525.217674:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789683525.217685:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789683525.217691:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850233344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683525.217732:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850233344:12345-0@lo:400:kworker.0 Request processed in 41us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683525.217738:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789683525.217748:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789683525.217753:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850232960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683525.217779:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850232960:12345-0@lo:400:kworker.0 Request processed in 26us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683525.217818:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789683525.217830:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789683525.217836:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850233472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683525.217866:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850233472:12345-0@lo:400:kworker.0 Request processed in 31us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683525.217871:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789683525.217882:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789683525.217888:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850232576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683525.217913:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850232576:12345-0@lo:400:kworker.0 Request processed in 26us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683525.217918:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00080000:0.0:1789683525.217935:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683525.217939:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683525.217941:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789683525.218024:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb61f0380 x1876618850232960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683525.218040:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850232960:0@lo:400:kworker.0 00010000:00080000:0.0:1789683525.218053:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb61f1180 x1876618850233472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683525.218062:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850233472:0@lo:400:kworker.0 00000100:00100000:0.0:1789683525.218074:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850232320:0@lo:400:kworker.0 00000100:00100000:0.0:1789683525.218084:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850232832:0@lo:400:kworker.0 00000100:00100000:0.0:1789683525.218096:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850233344:0@lo:400:kworker.0 00000100:00100000:3.0:1789683525.218396:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850232448 00000100:00100000:3.0:1789683525.218402:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850232448 00000100:00100000:3.0:1789683525.218459:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789683525.218468:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850232448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683525.218519:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850232448:12345-0@lo:400:kworker.0 Request processed in 53us (1849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683525.218524:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789683525.218555:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850232448:0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.218672:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683525.218723:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850233216:0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.218750:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683525.218768:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850233728:0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.218804:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683525.218830:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850232576:0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.218840:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850233088:0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.218850:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850233600:0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.218869:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850232192:0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.218898:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850233216 00000100:00100000:2.0:1789683525.218902:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850233216 00000100:00100000:2.0:1789683525.218935:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850233728 00000100:00100000:2.0:1789683525.218938:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850233728 00000100:00100000:2.0:1789683525.218958:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789683525.218964:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850233216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.219086:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850233216:12345-0@lo:400:kworker.0 Request processed in 121us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683525.219092:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789683525.219106:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789683525.219112:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850233728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.219140:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850233728:12345-0@lo:400:kworker.0 Request processed in 28us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683525.219146:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1789683525.219165:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683525.219168:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683525.219185:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:2.0:1789683525.219191:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0fb7961880, transno 4294967324 00000004:00080000:2.0:1789683525.219202:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967326 committed transno 4294967326 00000100:00100000:2.0:1789683525.219220:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850233216:0@lo:400:kworker.0 00000100:00100000:2.0:1789683525.219229:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1789683525.219232:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1789683525.219242:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0f88c74e00, transno 4294967311 00000100:00100000:2.0:1789683525.219251:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850233728:0@lo:400:kworker.0 00000100:00100000:1.0:1789683525.219467:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850233856 00000100:00100000:1.0:1789683525.219473:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850233856 00000100:00100000:1.0:1789683525.219509:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789683525.219517:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850233856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789683525.219534:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683525.219577:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850233856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (2966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683525.219582:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789683525.219860:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850232704 00000100:00100000:3.0:1789683525.219865:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850232704 00000100:00100000:3.0:1789683525.219907:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789683525.219915:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850232704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683525.219975:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850232704:12345-0@lo:400:kworker.0 Request processed in 60us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683525.219993:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789683525.220107:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850233856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683525.220268:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850232704:0@lo:400:kworker.0 00010000:00010000:0.0:1789683525.664908:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683526.692627:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789683526.811500:0:15015:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 18:18:45 (1789683525) 00000100:00100000:2.0:1789683527.194021:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683527.196913:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683527.196947:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683527.196969:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683527.196989:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683527.197009:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683527.197034:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683527.197068:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835506304 00000100:00100000:2.0:1789683527.197078:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835506304 00000100:00100000:2.0:1789683527.197137:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835506816 00000100:00100000:2.0:1789683527.197140:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835506816 00000100:00100000:2.0:1789683527.197155:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835506176 00000100:00100000:2.0:1789683527.197158:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835506176 00000100:00100000:2.0:1789683527.197191:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835506688 00000100:00100000:2.0:1789683527.197195:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835506688 00000100:00100000:2.0:1789683527.197214:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 349 00000100:00100000:2.0:1789683527.197223:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835506304:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683527.197298:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835506304:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 76us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683527.197306:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 349 00000100:00100000:2.0:1789683527.197324:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 350 00000100:00100000:2.0:1789683527.197330:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835506816:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683527.197356:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835506816:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683527.197361:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 350 00000100:00100000:2.0:1789683527.197376:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 351 00000100:00100000:2.0:1789683527.197382:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+19:2403:x1876618835506176:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683527.197413:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec036ece-1720-411a-849c-c978dbb41f8a+19:2403:x1876618835506176:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 31us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683527.197431:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 351 00000100:00100000:2.0:1789683527.197443:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 352 00000100:00100000:2.0:1789683527.197449:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835506688:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683527.197472:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:2403:x1876618835506688:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 23us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683527.197478:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 352 00000100:00100000:2.0:1789683527.197497:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835506560 00000100:00100000:2.0:1789683527.197500:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835506560 00000100:00100000:2.0:1789683527.197525:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835506432 00000100:00100000:2.0:1789683527.197529:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835506432 00000100:00100000:2.0:1789683527.197549:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 141 00000100:00100000:2.0:1789683527.197555:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835506560:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683527.197583:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2403:x1876618835506560:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 28us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683527.197589:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 141 00000100:00100000:2.0:1789683527.197600:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 142 00000100:00100000:2.0:1789683527.197606:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:2403:x1876618835506432:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683527.197630:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec036ece-1720-411a-849c-c978dbb41f8a+7:2403:x1876618835506432:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683527.197635:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 142 00000100:00080000:2.0:1789683527.197674:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789683527.197678:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683527.197680:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683527.197682:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789683527.203882:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835506048 00000100:00100000:0.0:1789683527.203900:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835506048 00000100:00100000:0.0:1789683527.204044:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 399 00000100:00100000:0.0:1789683527.204056:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:2403:x1876618835506048:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683527.204157:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+13:2403:x1876618835506048:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 103us (10147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683527.204166:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 399 00000100:00100000:3.0:1789683527.264324:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683527.264352:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850233984:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683527.264426:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683527.265405:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850233984 00000100:00100000:0.0:1789683527.265420:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850233984 00000100:00100000:0.0:1789683527.265484:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789683527.265494:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850233984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789683527.265533:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789683527.265610:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850233984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683527.265619:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789683527.269525:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850233984:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789683527.722609:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683527.778829:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850234112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683527.778941:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683527.780110:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850234112 00000100:00100000:1.0:1789683527.780124:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850234112 00000100:00100000:1.0:1789683527.780202:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789683527.780213:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850234112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789683527.780248:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789683527.780320:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850234112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683527.780343:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1789683527.780406:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683527.780463:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850234112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683528.287978:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683528.288001:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850234240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683528.288072:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683528.293494:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850234240 00000100:00100000:1.0:1789683528.293504:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850234240 00000100:00100000:1.0:1789683528.293580:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789683528.293591:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850234240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683528.293614:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789683528.293702:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850234240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (5629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683528.293709:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789683528.293762:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850234240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683528.293898:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850234368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683528.293952:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789683528.294121:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683528.294316:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850234368 00000100:00100000:1.0:1789683528.294321:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850234368 00000100:00100000:1.0:1789683528.294357:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789683528.294365:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850234368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683528.294392:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789683528.294428:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850234368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683528.294434:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789683528.294503:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850234368:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789683528.735837:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683529.258097:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683529.260132:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835506944 00000100:00100000:2.0:1789683529.260147:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835506944 00000100:00100000:2.0:1789683529.260253:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 256 00000100:00100000:2.0:1789683529.260266:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+5:13167:x1876618835506944:12345-192.168.201.50@tcp:101:lsof.0 00010000:00010000:2.0:1789683529.260290:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683529.260313:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a6cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc8e0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683529.260383:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a6d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683529.260399:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a6d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683529.260418:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a6d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683529.260473:0:8462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789683529.260477:0:8462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683529.260523:0:8462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a6d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683529.260548:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8e00/0xcf8485587b88a6cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8e0 expref: 7 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683529.260568:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a6d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8e0 expref: 6 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683529.260589:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e835a6200) 00010000:00010000:2.0:1789683529.260592:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683529.260596:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f9600, rc 0) 00000100:00100000:2.0:1789683529.260683:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+6:13167:x1876618835506944:12345-192.168.201.50@tcp:101:lsof.0 Request processed in 420us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683529.260691:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 256 00000100:00080000:0.0:1789683529.261531:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789683529.759125:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683529.823047:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850234496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683529.823121:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683529.824097:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850234496 00000100:00100000:0.0:1789683529.824109:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850234496 00000100:00100000:0.0:1789683529.824192:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789683529.824202:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850234496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789683529.824250:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789683529.824709:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789683529.826590:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1789683529.826603:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1789683529.826753:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1789683529.826771:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1789683529.837471:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850234496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 13260us (14339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683529.837490:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789683529.840305:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850234496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683530.336165:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850234880:0@lo:400:kworker.0 00000100:00100000:3.0:1789683530.336238:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850234752:0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.336260:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683530.336271:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683530.336327:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850235264:0@lo:400:kworker.0 00000100:00100000:1.0:1789683530.336399:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850234624:0@lo:400:kworker.0 00000100:00100000:0.0:1789683530.336561:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850234880 00000100:00100000:0.0:1789683530.336571:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850234880 00000100:00100000:0.0:1789683530.336657:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789683530.336667:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850234880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.337684:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850235392:0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.337729:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683530.337754:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850235904:0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.337772:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683530.337808:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789683530.337816:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850235008:0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.337836:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683530.337857:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850235520:0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.337880:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683530.337897:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850236032:0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.337914:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683530.337945:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850234752 00000100:00100000:2.0:1789683530.337977:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850234752 00000100:00100000:2.0:1789683530.338014:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850235392 00000100:00100000:2.0:1789683530.338017:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850235392 00000100:00100000:2.0:1789683530.338039:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850235904 00000100:00100000:2.0:1789683530.338041:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850235904 00000100:00100000:2.0:1789683530.338054:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850235008 00000100:00100000:2.0:1789683530.338056:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850235008 00000100:00100000:2.0:1789683530.339975:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789683530.339997:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850234752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.340304:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850234752:12345-0@lo:400:kworker.0 Request processed in 317us (4030us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683530.340312:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789683530.340349:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789683530.340358:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850235392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.340409:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850235392:12345-0@lo:400:kworker.0 Request processed in 54us (2680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683530.340416:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789683530.340428:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789683530.340435:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850235904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.340466:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850235904:12345-0@lo:400:kworker.0 Request processed in 32us (2692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683530.340472:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789683530.340484:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789683530.340490:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850235008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.340518:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850235008:12345-0@lo:400:kworker.0 Request processed in 29us (2682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683530.340524:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789683530.340569:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850235520 00000100:00100000:2.0:1789683530.340576:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850235520 00000100:00100000:2.0:1789683530.340747:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850236032 00000100:00100000:2.0:1789683530.340751:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850236032 00000100:00100000:2.0:1789683530.340771:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789683530.340777:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850235520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.340833:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850235520:12345-0@lo:400:kworker.0 Request processed in 56us (2952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683530.340839:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789683530.340851:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789683530.340858:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850236032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.340885:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850236032:12345-0@lo:400:kworker.0 Request processed in 28us (2970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683530.340890:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:2.0:1789683530.340915:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789683530.340919:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789683530.340955:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850235008:0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.340982:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850235520:0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.340991:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850236032:0@lo:400:kworker.0 00010000:00080000:2.0:1789683530.341005:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7247800 x1876618850235392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683530.341016:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850235392:0@lo:400:kworker.0 00010000:00080000:2.0:1789683530.341025:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7245c00 x1876618850235904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683530.341033:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850235904:0@lo:400:kworker.0 00000100:00100000:3.0:1789683530.346493:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683530.346591:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850235776:0@lo:400:kworker.0 00000100:00100000:3.0:1789683530.346643:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683530.346677:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850235264 00000100:00100000:3.0:1789683530.346879:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850235264 00000100:00100000:3.0:1789683530.346944:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850235776 00000100:00100000:3.0:1789683530.346949:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850235776 00000100:00100000:3.0:1789683530.346973:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789683530.346981:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850235264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683530.347037:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850235264:12345-0@lo:400:kworker.0 Request processed in 57us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683530.347043:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789683530.347057:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789683530.347063:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850235776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683530.347087:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850235776:12345-0@lo:400:kworker.0 Request processed in 25us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683530.347092:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00080000:3.0:1789683530.347111:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683530.347140:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850235776:0@lo:400:kworker.0 00000100:00100000:3.0:1789683530.347164:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850236288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683530.347630:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683530.347797:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850236288 00000100:00100000:2.0:1789683530.347804:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850236288 00000100:00100000:2.0:1789683530.347849:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789683530.347856:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850236288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683530.347874:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789683530.347914:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850236288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683530.347920:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:2.0:1789683530.347947:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683530.348332:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850234752:0@lo:400:kworker.0 00000100:00100000:3.0:1789683530.348356:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850235264:0@lo:400:kworker.0 00000100:00100000:3.0:1789683530.348390:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850236288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683530.349616:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683530.349661:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850235136:0@lo:400:kworker.0 00000100:00100000:1.0:1789683530.349702:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683530.349754:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850235648:0@lo:400:kworker.0 00000100:00100000:1.0:1789683530.349779:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683530.349833:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850235648 00000100:00100000:1.0:1789683530.349841:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850235648 00000100:00100000:1.0:1789683530.349896:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789683530.349905:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850235648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683530.349952:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850235648:12345-0@lo:400:kworker.0 Request processed in 48us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683530.349958:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1789683530.349991:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683530.350017:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850235648:0@lo:400:kworker.0 00000100:00100000:1.0:1789683530.350025:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850236160:0@lo:400:kworker.0 00000100:00100000:1.0:1789683530.350046:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683530.350080:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850236160 00000100:00100000:1.0:1789683530.350084:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850236160 00000100:00100000:1.0:1789683530.350108:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789683530.350114:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850236160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683530.350145:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850236160:12345-0@lo:400:kworker.0 Request processed in 32us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683530.350151:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789683530.350369:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850236160:0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.351091:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850234624 00000100:00100000:2.0:1789683530.351098:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850234624 00000100:00100000:2.0:1789683530.351144:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1789683530.351152:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850234624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.351218:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850234624:12345-0@lo:400:kworker.0 Request processed in 67us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683530.351225:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1789683530.351439:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850235136 00000100:00100000:3.0:1789683530.351444:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850235136 00000100:00100000:3.0:1789683530.351482:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789683530.351490:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850235136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683530.351529:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850235136:12345-0@lo:400:kworker.0 Request processed in 41us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683530.351536:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789683530.351632:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850234624:0@lo:400:kworker.0 00000100:00100000:1.0:1789683530.351645:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850235136:0@lo:400:kworker.0 00000100:00100000:0.0:1789683530.351778:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850234880:12345-0@lo:400:kworker.0 Request processed in 15112us (15516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683530.351801:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789683530.351877:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850234880:0@lo:400:kworker.0 00010000:00010000:2.0:1789683530.784711:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683531.259501:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683531.259857:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835507200 00000100:00100000:3.0:1789683531.259868:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835507200 00000100:00100000:2.0:1789683531.260392:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 66 00000100:00100000:2.0:1789683531.260407:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+18:13168:x1876618835507200:12345-192.168.201.50@tcp:35:umount.0 00000100:00080000:1.0:1789683531.260429:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683531.260823:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+19:13168:x1876618835507200:12345-192.168.201.50@tcp:35:umount.0 Request processed in 419us (1330us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789683531.260832:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 66 00000100:00100000:1.0:1789683531.271332:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683531.271626:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835507456 00000100:00100000:2.0:1789683531.271639:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835507456 00000100:00100000:2.0:1789683531.271707:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:2.0:1789683531.271719:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+19:13168:x1876618835507456:12345-192.168.201.50@tcp:35:umount.0 00000100:00100000:2.0:1789683531.272274:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+20:13168:x1876618835507456:12345-192.168.201.50@tcp:35:umount.0 Request processed in 555us (959us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1789683531.272283:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:0.0:1789683531.278007:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683531.278255:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835507712 00000100:00100000:2.0:1789683531.278267:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835507712 00000100:00100000:2.0:1789683531.278346:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 68 00000100:00100000:2.0:1789683531.278358:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f867ca850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+20:13168:x1876618835507712:12345-192.168.201.50@tcp:35:umount.0 00000100:00100000:2.0:1789683531.278866:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f867ca850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec036ece-1720-411a-849c-c978dbb41f8a+21:13168:x1876618835507712:12345-192.168.201.50@tcp:35:umount.0 Request processed in 508us (868us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789683531.278884:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 68 00000100:00100000:1.0:1789683531.282753:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683531.282882:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835507968 00000100:00100000:3.0:1789683531.282893:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835507968 00000100:00100000:3.0:1789683531.282952:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:3.0:1789683531.282964:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+21:13168:x1876618835507968:12345-192.168.201.50@tcp:35:umount.0 00000100:00100000:3.0:1789683531.283292:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec036ece-1720-411a-849c-c978dbb41f8a+22:13168:x1876618835507968:12345-192.168.201.50@tcp:35:umount.0 Request processed in 330us (548us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789683531.283301:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:1.0:1789683531.290675:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683531.290739:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683531.290827:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835508096 00000100:00100000:3.0:1789683531.290840:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835508096 00000100:00100000:3.0:1789683531.290930:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835508352 00000100:00100000:3.0:1789683531.290934:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835508352 00000100:00100000:3.0:1789683531.290982:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:3.0:1789683531.290993:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea7031b9-febc-4826-a965-62f420153ef7+14:2404:x1876618835508096:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683531.291009:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683531.291030:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f9400/0xcf8485587b88963d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc43a expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683531.291055:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683531.291108:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea7031b9-febc-4826-a965-62f420153ef7+13:2404:x1876618835508096:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 117us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683531.291116:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:3.0:1789683531.291134:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:3.0:1789683531.291140:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea7031b9-febc-4826-a965-62f420153ef7+12:2404:x1876618835508352:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683531.291147:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683531.291156:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837db400/0xcf8485587b8898d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc513 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683531.291165:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683531.291181:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea7031b9-febc-4826-a965-62f420153ef7+11:2404:x1876618835508352:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 42us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683531.291187:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:0.0:1789683531.294296:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683531.294482:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835508224 00000100:00100000:3.0:1789683531.294491:0:10343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835508224 00000100:00100000:3.0:1789683531.294561:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:3.0:1789683531.294571:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea7031b9-febc-4826-a965-62f420153ef7+11:2404:x1876618835508224:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683531.294597:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683531.294615:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837da000/0xcf8485587b8895fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc3fb expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683531.294643:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683531.294702:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea7031b9-febc-4826-a965-62f420153ef7+10:2404:x1876618835508224:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 133us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683531.294709:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:2.0:1789683531.297685:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683531.297830:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835508480 00000100:00100000:3.0:1789683531.297840:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835508480 00000100:00100000:3.0:1789683531.297910:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 81 00000100:00100000:3.0:1789683531.297919:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+5:2401:x1876618835508480:12345-192.168.201.50@tcp:9:umount.0 00000020:00000080:3.0:1789683531.297953:0:14000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8899d9 00000100:00080000:3.0:1789683531.297961:0:14000:0:(import.c:65:import_set_state_nolock()) ffff9f0e83e1a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789683531.297998:0:14000:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:2.0:1789683531.298175:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683531.298344:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec036ece-1720-411a-849c-c978dbb41f8a+2:2401:x1876618835508480:12345-192.168.201.50@tcp:9:umount.0 Request processed in 425us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683531.298353:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 81 00010000:00010000:1.0:1789683531.298471:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683531.303342:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683531.303556:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835508864 00000100:00100000:2.0:1789683531.303566:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835508864 00000100:00100000:2.0:1789683531.303654:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 82 00000100:00100000:2.0:1789683531.303665:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+7:2401:x1876618835508864:12345-192.168.201.50@tcp:9:umount.0 00000020:00000080:2.0:1789683531.303697:0:8440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889c4f 00000020:00010000:2.0:1789683531.303705:0:8440:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9f0fb79ab000: total 0 00000100:00080000:2.0:1789683531.303710:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9f0fb79ac000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789683531.303810:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:2.0:1789683531.303982:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec036ece-1720-411a-849c-c978dbb41f8a+5:2401:x1876618835508864:12345-192.168.201.50@tcp:9:umount.0 Request processed in 318us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683531.303991:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 82 00000020:00010000:0.0:1789683531.304140:0:9528:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9f0fb79ab000: total 0 00010000:00010000:0.0:1789683531.304178:0:9528:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0fb79ab000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789683531.304232:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000783ae124/0xcf8485587b88a6c8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8d9 expref: 4 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683531.304267:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf6fee0b/0xcf8485587b88a007 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6fd expref: 3 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683531.304283:0:9528:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0fb79ab000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789683531.304295:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683531.304297:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683531.304299:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789683531.306755:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683531.312891:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683531.313027:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835509888 00000100:00100000:3.0:1789683531.313039:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835509888 00000100:00100000:3.0:1789683531.313114:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 257 00000100:00100000:3.0:1789683531.313124:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+22:2401:x1876618835509888:12345-192.168.201.50@tcp:39:umount.0 00000020:00000080:3.0:1789683531.313160:0:6521:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88960c 00000020:00010000:3.0:1789683531.313177:0:6521:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9f0e82750800: total 0 00000100:00080000:3.0:1789683531.313183:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9f0fb613a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789683531.313213:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1789683531.313400:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec036ece-1720-411a-849c-c978dbb41f8a+21:2401:x1876618835509888:12345-192.168.201.50@tcp:39:umount.0 Request processed in 276us (528us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1789683531.313408:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 257 00000020:00010000:0.0:1789683531.313656:0:6509:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9f0e82750800: total 0 00010000:00010000:0.0:1789683531.313707:0:6509:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0e82750800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789683531.313741:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e835a6200) 00010000:00010000:0.0:1789683531.313750:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683531.313760:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88a062 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc712 expref: 20 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683531.313811:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:0.0:1789683531.313815:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789683531.313820:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454d400/0xcf8485587b88a36b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc7f2 expref: 19 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683531.313836:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:0.0:1789683531.313839:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789683531.313842:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b889ee8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6b0 expref: 18 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683531.313854:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f0f83e0b400) 00010000:00010000:0.0:1789683531.313856:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683531.313861:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b889938 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc521 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683531.313879:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:0.0:1789683531.313882:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789683531.313885:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c000/0xcf8485587b88a5a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc88c expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683531.313897:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:0.0:1789683531.313899:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789683531.313903:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b8899af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc53d expref: 15 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683531.313930:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:0.0:1789683531.313933:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683531.313937:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b889fc8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6e8 expref: 14 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683531.313949:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0fc11ebd00) 00010000:00010000:0.0:1789683531.313952:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789683531.313955:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88a07e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc719 expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683531.313971:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0f854c2c00) 00010000:00010000:0.0:1789683531.313973:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683531.313977:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c200/0xcf8485587b889954 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc528 expref: 12 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683531.313993:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:0.0:1789683531.313996:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789683531.313999:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8000/0xcf8485587b88a6b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8d2 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683531.314010:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0e826a2e00) 00010000:00010000:0.0:1789683531.314012:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789683531.314015:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176e00/0xcf8485587b889ff2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc6f6 expref: 10 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683531.314029:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0e826a2100) 00010000:00010000:0.0:1789683531.314031:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789683531.314041:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c800/0xcf8485587b889caa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc616 expref: 9 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683531.314060:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0f85396a00) 00010000:00010000:0.0:1789683531.314062:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683531.314066:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837daa00/0xcf8485587b88a689 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8c4 expref: 8 pid: 12533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683531.314079:0:6509:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0e82750800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789683531.314093:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683531.314095:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683531.314096:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683531.324879:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683531.325018:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835510016 00000100:00100000:3.0:1789683531.325028:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835510016 00000100:00100000:3.0:1789683531.325203:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 258 00000100:00100000:3.0:1789683531.325214:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+5:2401:x1876618835510016:12345-192.168.201.50@tcp:39:umount.0 00000020:00000080:3.0:1789683531.325255:0:6522:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889613 00000100:00080000:3.0:1789683531.325276:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9f0fc148a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789683531.325312:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789683531.325511:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec036ece-1720-411a-849c-c978dbb41f8a+3:2401:x1876618835510016:12345-192.168.201.50@tcp:39:umount.0 Request processed in 298us (643us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789683531.325520:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 258 00010000:00010000:0.0:1789683531.326295:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789683531.330999:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789683531.807536:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683532.321350:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683532.321408:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683532.321451:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683532.321604:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835510144 00000100:00100000:0.0:1789683532.321616:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835510144 00000100:00100000:0.0:1789683532.321686:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 401 00000100:00100000:0.0:1789683532.321698:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+10:2402:x1876618835510144:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683532.321777:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea7031b9-febc-4826-a965-62f420153ef7+10:2402:x1876618835510144:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 81us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683532.321821:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 401 00000100:00100000:2.0:1789683532.321911:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835510400 00000100:00100000:2.0:1789683532.321931:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835510400 00000100:00100000:2.0:1789683532.321984:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835510272 00000100:00100000:2.0:1789683532.321988:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835510272 00000100:00100000:2.0:1789683532.322023:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 359 00000100:00100000:2.0:1789683532.322030:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835510400:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683532.322064:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+5:2402:x1876618835510400:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 35us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683532.322070:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 359 00000100:00100000:2.0:1789683532.322084:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 360 00000100:00100000:2.0:1789683532.322091:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+6:2402:x1876618835510272:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683532.322115:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13ee1651-c170-427a-b389-1f9d341ed790+6:2402:x1876618835510272:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683532.322121:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 360 00000100:00080000:0.0:1789683532.322451:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683532.322456:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789683532.383206:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683532.383238:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850236416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789683532.383326:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683532.383468:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850236416 00000100:00100000:0.0:1789683532.383479:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850236416 00000100:00100000:0.0:1789683532.383533:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789683532.383543:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850236416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789683532.383589:0:7879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789683532.383652:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850236416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683532.383675:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789683532.383768:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850236416:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1789683532.831577:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789683532.834550:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683532.895225:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683532.895250:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850236544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683532.895338:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683532.895574:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850236544 00000100:00100000:1.0:1789683532.895583:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850236544 00000100:00100000:1.0:1789683532.895648:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789683532.895659:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850236544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789683532.895690:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789683532.895747:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850236544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683532.895754:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1789683532.896037:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683532.896170:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850236544:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1789683533.023421:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683533.023435:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683533.023565:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789683533.023576:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789683533.407307:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850236672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683533.407419:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683533.408151:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850236672 00000100:00100000:2.0:1789683533.408162:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850236672 00000100:00100000:2.0:1789683533.408243:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789683533.408253:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850236672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789683533.408282:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789683533.408346:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850236672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683533.408353:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1789683533.408438:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683533.408854:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850236672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683533.409003:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683533.409016:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850236800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683533.409067:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683533.409162:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850236800 00000100:00100000:2.0:1789683533.409169:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850236800 00000100:00100000:2.0:1789683533.409212:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789683533.409221:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850236800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683533.409258:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789683533.409311:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850236800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683533.409318:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789683533.410918:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850236800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683533.411363:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683533.411405:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683533.411441:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683533.411838:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835510528 00000100:00100000:3.0:1789683533.411845:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835510528 00000100:00100000:3.0:1789683533.412026:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835510784 00000100:00100000:3.0:1789683533.412030:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835510784 00000100:00100000:3.0:1789683533.412045:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835510656 00000100:00100000:3.0:1789683533.412048:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835510656 00000100:00100000:3.0:1789683533.412064:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:3.0:1789683533.412072:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea7031b9-febc-4826-a965-62f420153ef7+12:2403:x1876618835510528:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683533.412086:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683533.412105:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81390a00/0xcf8485587b88970f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc44f expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683533.412124:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683533.412192:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea7031b9-febc-4826-a965-62f420153ef7+11:2403:x1876618835510528:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 119us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683533.412200:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:3.0:1789683533.412218:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:3.0:1789683533.412224:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84447050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea7031b9-febc-4826-a965-62f420153ef7+10:2403:x1876618835510784:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683533.412233:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683533.412245:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837dba00/0xcf8485587b8898cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc50c expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683533.412254:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683533.412272:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84447050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea7031b9-febc-4826-a965-62f420153ef7+9:2403:x1876618835510784:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 48us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683533.412278:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:3.0:1789683533.412323:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:3.0:1789683533.412330:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea7031b9-febc-4826-a965-62f420153ef7+8:2403:x1876618835510656:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683533.412338:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683533.412347:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81390e00/0xcf8485587b889716 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc480 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683533.412356:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683533.412373:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea7031b9-febc-4826-a965-62f420153ef7+7:2403:x1876618835510656:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 44us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683533.412379:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:2.0:1789683533.434292:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683533.434565:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835511040 00000100:00100000:3.0:1789683533.434576:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835511040 00000100:00100000:3.0:1789683533.434635:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 259 00000100:00100000:3.0:1789683533.434645:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+6:2401:x1876618835511040:12345-192.168.201.50@tcp:39:umount.0 00000020:00000080:3.0:1789683533.434718:0:8462:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889724 00000020:00010000:3.0:1789683533.434729:0:8462:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9f0fc1489800: total 0 00000100:00080000:3.0:1789683533.434734:0:8462:0:(import.c:65:import_set_state_nolock()) ffff9f0fc148a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789683533.434769:0:8462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:0.0:1789683533.435050:0:6509:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9f0fc1489800: total 0 00010000:00010000:0.0:1789683533.435098:0:6509:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0fc1489800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789683533.435129:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0e835a6200) 00010000:00010000:0.0:1789683533.435133:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683533.435141:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88a6d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8e0 expref: 5 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683533.435166:0:6509:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0fc1489800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789683533.435176:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683533.435178:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683533.435179:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683533.435463:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13ee1651-c170-427a-b389-1f9d341ed790+3:2401:x1876618835511040:12345-192.168.201.50@tcp:39:umount.0 Request processed in 818us (1185us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1789683533.435472:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 259 00000100:00100000:3.0:1789683533.463955:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683533.464065:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835511168 00000100:00100000:2.0:1789683533.464079:0:12533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835511168 00000100:00100000:2.0:1789683533.464151:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 260 00000100:00100000:2.0:1789683533.464164:0:12533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+5:2401:x1876618835511168:12345-192.168.201.50@tcp:39:umount.0 00000020:00000080:2.0:1789683533.464216:0:12533:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88972b 00000100:00080000:2.0:1789683533.464228:0:12533:0:(import.c:65:import_set_state_nolock()) ffff9f0fc148c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789683533.464265:0:12533:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789683533.464483:0:12533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13ee1651-c170-427a-b389-1f9d341ed790+3:2401:x1876618835511168:12345-192.168.201.50@tcp:39:umount.0 Request processed in 321us (541us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789683533.464492:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 260 00010000:00010000:0.0:1789683533.464619:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683533.515609:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683533.516002:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835511424 00000100:00100000:1.0:1789683533.516016:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835511424 00000100:00100000:1.0:1789683533.516077:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 402 00000100:00100000:1.0:1789683533.516087:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8476cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+7:2401:x1876618835511424:12345-192.168.201.50@tcp:251:umount.0 00000020:00000080:1.0:1789683533.516136:0:6514:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8895e9 00000020:00010000:1.0:1789683533.516146:0:6514:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9f0fb240e800: total 0 00000100:00080000:1.0:1789683533.516151:0:6514:0:(import.c:65:import_set_state_nolock()) ffff9f0e82750000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789683533.516247:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8476cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea7031b9-febc-4826-a965-62f420153ef7+3:2401:x1876618835511424:12345-192.168.201.50@tcp:251:umount.0 Request processed in 160us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683533.516258:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 402 00000020:00010000:3.0:1789683533.516345:0:9527:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9f0fb240e800: total 0 00010000:00010000:3.0:1789683533.516352:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683533.516419:0:9527:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0fb240e800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789683533.516470:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f829e0800/0xcf8485587b889644 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc441 expref: 2 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683533.516492:0:9527:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0fb240e800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789683533.516505:0:9527:0:(genops.c:885:class_export_put()) final put ffff9f0fb240e800/ea7031b9-febc-4826-a965-62f420153ef7 00010000:00010000:3.0:1789683533.516522:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683533.516524:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683533.516526:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789683533.516536:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb240e800/ea7031b9-febc-4826-a965-62f420153ef7 for MGS 00000020:00000080:3.0:1789683533.520686:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e82750000 for MGS 00010000:00010000:1.0:1789683533.857064:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683534.878900:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683534.943338:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683534.943373:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850236928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789683534.943470:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683534.943591:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850236928 00000100:00100000:1.0:1789683534.943600:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850236928 00000100:00100000:1.0:1789683534.943667:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789683534.943679:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850236928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789683534.943713:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789683534.943764:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850236928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683534.943771:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1789683534.943926:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683534.944063:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850236928:0@lo:13:osp-pre-1-1.0 00000020:01000004:1.0:1789683535.306596:0:15211:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789683535.342366:0:15211:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789683535.342424:0:15211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b88969f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.342438:0:15211:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b88969f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8896a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.342445:0:15211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b88969f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b8896a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.343041:0:15211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b88969f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b8896a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.343066:0:15211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789683535.344058:0:15211:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1789683535.344597:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683535.344618:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b88969f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b8896a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.344647:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f80031a00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683535.344651:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b88969f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b8896a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.344660:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b88969f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b8896a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683535.344667:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b88969f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b8896a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683535.344673:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789683535.344675:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789683535.344678:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789683535.344719:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b88969f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b8896a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.344726:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683535.344767:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b88969f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b8896a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.344775:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f80031a00/0xcf8485587b88969f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b8896a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.344831:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.344833:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.344835:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683535.344842:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683535.344863:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850237056:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789683535.345004:0:15211:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789683535.345008:0:15211:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789683535.345016:0:15211:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789683535.345030:0:15211:0:(import.c:65:import_set_state_nolock()) ffff9f0f88c5d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789683535.345052:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876618850237184:0@lo:39:umount.0 00000100:00100000:2.0:1789683535.345364:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683535.346366:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850237184 00000100:00100000:3.0:1789683535.346377:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850237184 00000100:00100000:3.0:1789683535.346457:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789683535.346467:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876618850237184:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789683535.346498:0:6522:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889200 00000100:00080000:3.0:1789683535.346507:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9f0fc06a5800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789683535.346840:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683535.346895:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3646:x1876618850237184:12345-0@lo:39:umount.0 Request processed in 140us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683535.346916:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:3.0:1789683535.346926:0:6522:0:(genops.c:885:class_export_put()) final put ffff9f0fc06a1000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1789683535.346986:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f88c5d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789683535.346998:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876618850237184:0@lo:39:umount.0 00000100:00080000:3.0:1789683535.347037:0:15211:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789683535.347040:0:15211:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789683535.347044:0:15211:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1789683535.347700:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683535.347766:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850237056 00000100:00100000:0.0:1789683535.347772:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850237056 00000100:00100000:0.0:1789683535.347838:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789683535.347847:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3649:x1876618850237056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683535.347859:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683535.347877:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837db800/0xcf8485587b8896a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88969f expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.347893:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683535.347922:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:3649:x1876618850237056:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683535.347928:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789683535.347954:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850237056:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1789683535.348288:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc06a1000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789683535.348349:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fc06a5800 for lustre-MDT0000 00010000:00010000:3.0:1789683535.349442:0:15211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b8896ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8896b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.349457:0:15211:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b8896ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8896b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.349464:0:15211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b8896ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b8896b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.349471:0:15211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b8896ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b8896b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.349496:0:15211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683535.349501:0:15211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b8895a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8895aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.349508:0:15211:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b8895a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8895aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.349525:0:15211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b8895a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b8895aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.349547:0:15211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b8895a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b8895aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.349568:0:15211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789683535.349576:0:15211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176000/0xcf8485587b889907 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88990e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.349583:0:15211:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176000/0xcf8485587b889907 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88990e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.349588:0:15211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176000/0xcf8485587b889907 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88990e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.349595:0:15211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176000/0xcf8485587b889907 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88990e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.349606:0:15211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789683535.349684:0:15211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80030800/0xcf8485587b88915f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889166 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.349692:0:15211:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80030800/0xcf8485587b88915f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889166 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.349698:0:15211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80030800/0xcf8485587b88915f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b889166 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.349703:0:15211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0f80030800/0xcf8485587b88915f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b889166 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.349724:0:15211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1789683535.349727:0:15211:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789683535.349761:0:15211:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789683535.349765:0:15211:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789683535.349770:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683535.349775:0:15211:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1789683535.349806:0:15211:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9f0e82754800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789683535.349812:0:15211:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9f0e810cc800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789683535.349816:0:15211:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9f0fc1202800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789683535.349820:0:15211:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9f0fa5336800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1789683535.349827:0:15211:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9f0fc1489800 13ee1651-c170-427a-b389-1f9d341ed790 192.168.201.50@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789683535.349832:0:15211:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9f0e82750800 ec036ece-1720-411a-849c-c978dbb41f8a 192.168.201.50@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:3.0:1789683535.349837:0:15211:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9f0fa719cd40) has exports, disconnecting them 00010000:00010000:1.0:1789683535.350047:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789683535.350053:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b8896ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b8896b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350075:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8400 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683535.350079:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b8896ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b8896b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350086:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b8896ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b8896b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683535.350093:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b8896ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b8896b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683535.350098:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789683535.350101:0:9528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1789683535.350103:0:9528:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1789683535.350136:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b8896ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b8896b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350142:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683535.350167:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b8896ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b8896b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350304:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8400/0xcf8485587b8896ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b8896b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350319:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789683535.350323:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b8895a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b8895aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350329:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9200 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683535.350332:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b8895a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b8895aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350346:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b8895a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b8895aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683535.350352:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b8895a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b8895aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683535.350357:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789683535.350359:0:9528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789683535.350361:0:9528:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789683535.350375:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b8895a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b8895aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350381:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683535.350388:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b8895a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b8895aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350394:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b8895a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b8895aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350403:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683535.350407:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176000/0xcf8485587b889907 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88990e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350412:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176000 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683535.350415:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176000/0xcf8485587b889907 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88990e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350422:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176000/0xcf8485587b889907 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88990e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683535.350439:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176000/0xcf8485587b889907 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88990e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683535.350444:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789683535.350445:0:9528:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789683535.350447:0:9528:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789683535.350459:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176000/0xcf8485587b889907 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88990e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350465:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683535.350481:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176000/0xcf8485587b889907 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88990e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350488:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176000/0xcf8485587b889907 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88990e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350497:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683535.350500:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f80030800/0xcf8485587b88915f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b889166 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350505:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f80030800 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683535.350508:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80030800/0xcf8485587b88915f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b889166 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350524:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f80030800/0xcf8485587b88915f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b889166 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683535.350529:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80030800/0xcf8485587b88915f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b889166 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683535.350544:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789683535.350546:0:9528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789683535.350548:0:9528:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789683535.350561:0:9528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f80030800/0xcf8485587b88915f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b889166 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350566:0:9528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683535.350574:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f80030800/0xcf8485587b88915f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b889166 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350579:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f80030800/0xcf8485587b88915f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b889166 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.350587:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.350589:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.350591:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683535.350620:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850237312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683535.350680:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683535.350721:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683535.350726:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850237440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683535.350746:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683535.350776:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850237696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683535.350819:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683535.350837:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683535.350854:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850237568:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683535.351115:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.351123:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789683535.351297:0:15211:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f0e82754800), last request at 1789683530 00000020:00000080:3.0:1789683535.351306:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889510 00000100:00080000:3.0:1789683535.351322:0:15211:0:(import.c:65:import_set_state_nolock()) ffff9f0e82757000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789683535.351390:0:15211:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0e82754800): rc 0 00000020:00000080:3.0:1789683535.351393:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0e82754800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789683535.351402:0:15211:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f0e810cc800), last request at 1789683530 00000020:00000080:3.0:1789683535.351405:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8893ea 00000100:00080000:3.0:1789683535.351410:0:15211:0:(import.c:65:import_set_state_nolock()) ffff9f0e810cc000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789683535.351418:0:15211:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0e810cc800): rc 0 00000020:00000080:3.0:1789683535.351420:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0e810cc800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1789683535.351423:0:15211:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f0fc1202800), last request at 1789683303 00000020:00000080:3.0:1789683535.351426:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8892e7 00000100:00080000:3.0:1789683535.351437:0:15211:0:(import.c:65:import_set_state_nolock()) ffff9f0fc1200000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789683535.351445:0:15211:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0fc1202800): rc 0 00000020:00000080:3.0:1789683535.351448:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0fc1202800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1789683535.351451:0:15211:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f0fa5336800), last request at 1789683303 00000020:00000080:3.0:1789683535.351455:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8892a8 00000100:00080000:3.0:1789683535.351458:0:15211:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5186000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789683535.351463:0:15211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:3.0:1789683535.351542:0:15211:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0fa5336800): rc 0 00000004:00000080:3.0:1789683535.351547:0:15211:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffba8341dbbae0 00000100:00080000:3.0:1789683535.351564:0:15211:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789683535.351567:0:15211:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:1.0:1789683535.351698:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683535.351741:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850237312 00000100:00100000:1.0:1789683535.351753:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850237312 00000100:00100000:1.0:1789683535.351812:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850237440 00000100:00100000:1.0:1789683535.351816:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850237440 00000100:00100000:1.0:1789683535.351830:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850237696 00000100:00100000:1.0:1789683535.351832:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850237696 00000100:00100000:1.0:1789683535.351844:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850237568 00000100:00100000:1.0:1789683535.351846:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850237568 00000100:00100000:1.0:1789683535.351869:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789683535.352140:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+26:3647:x1876618850237312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683535.352155:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683535.352247:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f80031c00/0xcf8485587b8896b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b8896ad expref: 26 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.352264:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683535.352311:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+25:3647:x1876618850237312:12345-0@lo:103:ldlm_bl.0 Request processed in 433us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683535.352318:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789683535.352337:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789683535.352343:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+24:3647:x1876618850237440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683535.352351:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683535.352360:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81390c00/0xcf8485587b8895aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b8895a3 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.352370:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683535.352392:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+23:3647:x1876618850237440:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683535.352398:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789683535.352411:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789683535.352417:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+22:3650:x1876618850237696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683535.352432:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683535.352441:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f8a00/0xcf8485587b889166 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88915f expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.352450:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683535.352477:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+21:3650:x1876618850237696:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683535.352484:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789683535.352497:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789683535.352502:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+20:3650:x1876618850237568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683535.352509:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683535.352529:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837da400/0xcf8485587b88990e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b889907 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.352537:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683535.352557:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e97b3c51-c653-4f2f-8e95-54cfcf70f127+19:3650:x1876618850237568:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683535.352562:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1789683535.352590:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789683535.353043:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82754800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789683535.353102:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e810cc800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789683535.353124:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc1202800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789683535.353145:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e82757000 for lustre-MDT0000 00000020:00000080:0.0:1789683535.353149:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e810cc000 for lustre-MDT0000 00000020:00000080:0.0:1789683535.353152:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fc1200000 for lustre-MDT0000 00010000:00010000:0.0:1789683535.353162:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.353167:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.353171:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683535.354059:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850237568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683535.354221:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850237440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683535.354232:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850237312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683535.354349:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850237696:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789683535.357573:0:15211:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789683535.357621:0:15211:0:(import.c:65:import_set_state_nolock()) ffff9f0fc1207000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789683535.357729:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850237824:0@lo:39:umount.0 00000100:00100000:0.0:1789683535.357854:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683535.358425:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850237824 00000100:00100000:3.0:1789683535.358433:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850237824 00000100:00100000:3.0:1789683535.358486:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789683535.358496:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876618850237824:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789683535.358535:0:6526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889342 00000100:00080000:3.0:1789683535.358544:0:6526:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5187000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789683535.358574:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1789683535.358729:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3646:x1876618850237824:12345-0@lo:39:umount.0 Request processed in 234us (875us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789683535.358737:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:3.0:1789683535.358837:0:15211:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789683535.358841:0:15211:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 3 00000004:00080000:3.0:1789683535.358852:0:15211:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789683535.359265:0:15211:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789683535.359283:0:15211:0:(import.c:65:import_set_state_nolock()) ffff9f0fc17f3800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789683535.359308:0:15211:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789683535.359310:0:15211:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1789683535.359327:0:15211:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789683535.359384:0:15211:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789683535.359394:0:15211:0:(import.c:65:import_set_state_nolock()) ffff9f0e83c36000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789683535.359422:0:15211:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9f0fa719cd40) has no exports 00000100:00100000:1.0:1789683535.359572:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683535.359591:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:0:1876618850238208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683535.360127:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850237952:0@lo:9:umount.0 00000100:00100000:0.0:1789683535.360195:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683535.360229:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850238080:0@lo:9:umount.0 00000100:00100000:0.0:1789683535.360251:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789683535.360288:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc1207000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789683535.360294:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850237824:0@lo:39:umount.0 00000100:00100000:0.0:1789683535.360325:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850237952 00000100:00100000:0.0:1789683535.360330:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850237952 00000100:00100000:0.0:1789683535.360373:0:14000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850238080 00000100:00100000:0.0:1789683535.360377:0:14000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850238080 00000100:00100000:0.0:1789683535.360401:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789683535.360410:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1876618850237952:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789683535.360434:0:14000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889492 00000100:00080000:0.0:1789683535.360442:0:14000:0:(import.c:65:import_set_state_nolock()) ffff9f0e81fac800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789683535.360480:0:14000:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:0.0:1789683535.360601:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3646:x1876618850237952:12345-0@lo:9:umount.0 Request processed in 192us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683535.360621:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789683535.360636:0:14000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789683535.360641:0:14000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1876618850238080:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789683535.360653:0:14000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8895d4 00000100:00080000:0.0:1789683535.360658:0:14000:0:(import.c:65:import_set_state_nolock()) ffff9f0e83440800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789683535.360682:0:14000:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789683535.360752:0:14000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3646:x1876618850238080:12345-0@lo:9:umount.0 Request processed in 110us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683535.360772:0:14000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1789683535.360817:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683535.360821:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789683535.360838:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.360855:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789683535.360889:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc17f3800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789683535.360900:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789683535.360902:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789683535.360905:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850237952:0@lo:9:umount.0 00000100:00080000:0.0:1789683535.360916:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83c36000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789683535.360922:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789683535.360923:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789683535.360925:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850238080:0@lo:9:umount.0 00010000:00010000:0.0:1789683535.360951:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789683535.372621:0:15211:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9f0fa719cd40) has no exports 00000020:00000080:3.0:1789683535.432406:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8891ba 00000020:00000080:3.0:1789683535.432423:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0fc0502800/lustre-QMT0000_UUID 00000020:01000000:3.0:1789683535.432444:0:15211:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789683535.432623:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc0502800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789683535.432747:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789683535.432760:0:15211:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789683535.432765:0:15211:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9f0fc04dcd40) has no exports 00000020:00000080:2.0:1789683535.433493:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8891b3 00000020:00000080:2.0:1789683535.433501:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0fc04cf800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789683535.433573:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683535.433583:0:15211:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789683535.433586:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0fc04cd800/lustre-QMT0000_UUID 00000020:00000080:2.0:1789683535.433589:0:15211:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc04cd800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789683535.433596:0:15211:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1789683535.433703:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc04cf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1789683535.456930:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850238336:0@lo:400:kworker.0 00000100:00100000:1.0:1789683535.457007:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683535.457090:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850238848:0@lo:400:kworker.0 00000100:00100000:1.0:1789683535.457117:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683535.457147:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789683535.457153:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850238720:0@lo:400:kworker.0 00000100:00100000:1.0:1789683535.457178:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683535.457197:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850239232:0@lo:400:kworker.0 00000100:00100000:1.0:1789683535.457217:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683535.457249:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850238848 00000100:00100000:1.0:1789683535.457257:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850238848 00000100:00100000:1.0:1789683535.457308:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850239232 00000100:00100000:1.0:1789683535.457311:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850239232 00000100:00100000:1.0:1789683535.457333:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789683535.457342:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850238848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683535.457410:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850238848:12345-0@lo:400:kworker.0 Request processed in 69us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683535.457417:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789683535.457434:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789683535.457440:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850239232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683535.457468:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850239232:12345-0@lo:400:kworker.0 Request processed in 28us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683535.457474:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789683535.457492:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850238720 00000100:00100000:1.0:1789683535.457496:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850238720 00000100:00100000:1.0:1789683535.457534:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1789683535.457541:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850238720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683535.457572:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850238720:12345-0@lo:400:kworker.0 Request processed in 32us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683535.457588:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00080000:1.0:1789683535.457615:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789683535.457619:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789683535.457643:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb61f1f80 x1876618850238720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683535.457657:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850238720:0@lo:400:kworker.0 00000100:00100000:1.0:1789683535.457668:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850239232:0@lo:400:kworker.0 00000100:00100000:1.0:1789683535.457676:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850238848:0@lo:400:kworker.0 00000100:00100000:1.0:1789683535.457714:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850238592:0@lo:400:kworker.0 00000100:00100000:1.0:1789683535.457739:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683535.457763:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850239104:0@lo:400:kworker.0 00000100:00100000:1.0:1789683535.457810:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683535.457845:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789683535.457852:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb61f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850238464:0@lo:400:kworker.0 00000100:00100000:1.0:1789683535.457874:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683535.457896:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850238976:0@lo:400:kworker.0 00000100:00100000:1.0:1789683535.457917:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683535.457939:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850238592 00000100:00100000:1.0:1789683535.457943:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850238592 00000100:00100000:1.0:1789683535.457963:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850239104 00000100:00100000:1.0:1789683535.457965:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850239104 00000100:00100000:1.0:1789683535.457982:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850238464 00000100:00100000:1.0:1789683535.457985:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850238464 00000100:00100000:1.0:1789683535.457993:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850238976 00000100:00100000:1.0:1789683535.457994:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850238976 00000100:00100000:1.0:1789683535.458014:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1789683535.458020:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850239104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683535.458054:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850239104:12345-0@lo:400:kworker.0 Request processed in 34us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683535.458060:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1789683535.458073:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789683535.458077:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1876618850238592:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789683535.458082:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789683535.458105:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1876618850238592:12345-0@lo:400:kworker.0 Request processed in 28us (366us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789683535.458110:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789683535.458122:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789683535.458126:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1876618850238464:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789683535.458130:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789683535.458151:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1876618850238464:12345-0@lo:400:kworker.0 Request processed in 24us (276us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789683535.458156:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789683535.458166:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789683535.458170:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1876618850238976:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789683535.458174:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789683535.458194:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1876618850238976:12345-0@lo:400:kworker.0 Request processed in 23us (277us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789683535.458199:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1789683535.458221:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789683535.458236:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789683535.458241:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9f0fc1205800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789683535.458245:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1789683535.459309:0:7879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850238336 00000100:00100000:3.0:1789683535.459316:0:7879:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850238336 00000100:00100000:3.0:1789683535.459347:0:7879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789683535.459352:0:7879:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1876618850238336:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789683535.459358:0:7879:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789683535.459401:0:7879:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1876618850238336:12345-0@lo:400:kworker.0 Request processed in 48us (2394us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789683535.459406:0:7879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:0.0:1789683535.459854:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789683535.459858:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9f0f88c69000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789683535.459862:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789683535.459868:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9f0f88c69000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789683535.459872:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 217 00000100:00080000:0.0:1789683535.459881:0:3648:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f0f88c69000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789683535.459920:0:3648:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0f88c74e00 x1876618850239360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789683535.459950:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850238336:0@lo:400:kworker.0 00000100:00100000:2.0:1789683535.460117:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850239360:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789683535.460156:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683535.460246:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850239360 00000100:00100000:3.0:1789683535.460252:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850239360 00000100:00100000:3.0:1789683535.460283:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789683535.460288:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850239360:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1789683535.460303:0:6527:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1789683535.470621:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9f0fc1205800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683535.470632:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 217 00000100:00080000:1.0:1789683535.470658:0:3650:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f0fc1205800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683535.470731:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb799b100 x1876618850239488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683535.470762:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850238464:0@lo:400:kworker.0 00000100:00100000:2.0:1789683535.471069:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876618850239488:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1789683535.471132:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789683535.471247:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789683535.471251:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9f0e83442000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789683535.471255:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789683535.471259:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9f0e83442000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683535.471262:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 259 00000100:00080000:1.0:1789683535.471267:0:3650:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f0e83442000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683535.471283:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850239488 00000100:00100000:1.0:1789683535.471289:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850239488 00000100:00100000:1.0:1789683535.471325:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789683535.471332:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876618850239488:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1789683535.471348:0:6521:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789683535.471391:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876618850239488:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 59us (259us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789683535.471398:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1789683535.471428:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc1205800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789683535.471433:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789683535.471436:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876618850239488:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789683535.471463:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb799b100 x1876618850239616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683535.471494:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850238976:0@lo:400:kworker.0 00000100:00100000:1.0:1789683535.471504:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1876618850239616:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789683535.471542:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683535.471570:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850239616 00000100:00100000:1.0:1789683535.471574:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850239616 00000100:00100000:1.0:1789683535.471594:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789683535.471599:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1876618850239616:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1789683535.471607:0:6522:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789683535.471636:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1876618850239616:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 35us (93us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789683535.471641:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1789683535.471665:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83442000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789683535.471669:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789683535.471671:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1876618850239616:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1789683535.471694:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789683535.471696:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5158000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789683535.471699:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789683535.471702:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5158000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683535.471705:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 237 00000100:00080000:1.0:1789683535.471710:0:3650:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f0fb5158000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683535.471723:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb799b100 x1876618850239744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683535.471739:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb61f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850238592:0@lo:400:kworker.0 00000100:00100000:1.0:1789683535.471757:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1876618850239744:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789683535.471810:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683535.471842:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850239744 00000100:00100000:1.0:1789683535.471846:0:8462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850239744 00000100:00100000:1.0:1789683535.471866:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789683535.471871:0:8462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1876618850239744:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1789683535.471879:0:8462:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789683535.471908:0:8462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1876618850239744:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 36us (125us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789683535.471913:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1789683535.471936:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5158000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789683535.471940:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789683535.471943:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1876618850239744:0@lo:38:ptlrpcd_00_03.0 00010000:00080000:1.0:1789683535.471965:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7963100 x1876618850239104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683535.471976:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850239104:0@lo:400:kworker.0 00000100:00100000:2.0:1789683535.484207:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850239360:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 23908us (24040us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789683535.484238:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:1.0:1789683535.485632:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f88c69000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789683535.485641:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789683535.485646:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850239360:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1789683535.904007:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683536.928345:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789683537.001568:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789683537.001579:0:8433:0:(genops.c:885:class_export_put()) final put ffff9f0e81fac000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789683537.001599:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec036ece-1720-411a-849c-c978dbb41f8a 00000020:00000080:3.0:1789683537.001602:0:8433:0:(genops.c:885:class_export_put()) final put ffff9f0fb79ab000/ec036ece-1720-411a-849c-c978dbb41f8a 00000020:00000080:1.0:1789683537.005678:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e81fac000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789683537.005740:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb79ab000/ec036ece-1720-411a-849c-c978dbb41f8a for lustre-OST0000 00000020:00000080:1.0:1789683537.005759:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e81fac800 for lustre-OST0000 00000020:00000080:1.0:1789683537.005763:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fb79ac000 for lustre-OST0000 00000001:00100000:0.0:1789683537.006574:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789683537.006592:0:9518:0:(genops.c:885:class_export_put()) final put ffff9f0e83446000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789683537.006654:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec036ece-1720-411a-849c-c978dbb41f8a 00000020:00000080:0.0:1789683537.006657:0:9518:0:(genops.c:885:class_export_put()) final put ffff9f0e83e1b000/ec036ece-1720-411a-849c-c978dbb41f8a 00000020:00000080:3.0:1789683537.011013:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83446000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789683537.011090:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e83440800 for lustre-OST0001 00000020:00000080:1.0:1789683537.016773:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83e1b000/ec036ece-1720-411a-849c-c978dbb41f8a for lustre-OST0001 00000020:00000080:1.0:1789683537.017309:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e83e1a000 for lustre-OST0001 00000001:00100000:3.0:1789683537.019162:0:7455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789683537.019178:0:7455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1789683537.019185:0:7455:0:(genops.c:885:class_export_put()) final put ffff9f0fb5181000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789683537.019208:0:7455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 13ee1651-c170-427a-b389-1f9d341ed790 00000001:00080000:3.0:1789683537.019215:0:7455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1789683537.019218:0:7455:0:(genops.c:885:class_export_put()) final put ffff9f0fc148f800/13ee1651-c170-427a-b389-1f9d341ed790 00000001:00100000:3.0:1789683537.019225:0:7455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ec036ece-1720-411a-849c-c978dbb41f8a 00000001:00080000:3.0:1789683537.019229:0:7455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1789683537.019231:0:7455:0:(genops.c:885:class_export_put()) final put ffff9f0fc1489000/ec036ece-1720-411a-849c-c978dbb41f8a 00000020:00000080:0.0:1789683537.019410:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb5181000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1789683537.019498:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc148f800/13ee1651-c170-427a-b389-1f9d341ed790 for lustre-MDT0001 00000020:00000080:0.0:1789683537.019526:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc1489000/ec036ece-1720-411a-849c-c978dbb41f8a for lustre-MDT0001 00000020:00000080:0.0:1789683537.019549:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fb5187000 for lustre-MDT0001 00000020:00000080:0.0:1789683537.019555:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fc148c000 for lustre-MDT0001 00000020:00000080:0.0:1789683537.019558:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fc148a800 for lustre-MDT0001 00000001:00100000:3.0:1789683537.019689:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789683537.019693:0:6500:0:(genops.c:885:class_export_put()) final put ffff9f0fa5336800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1789683537.019710:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 13ee1651-c170-427a-b389-1f9d341ed790 00000001:00080000:3.0:1789683537.019716:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1789683537.019840:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fa5336800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1789683537.019876:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fb5186000 for lustre-MDT0000 00000020:00000080:3.0:1789683537.020144:0:6500:0:(genops.c:885:class_export_put()) final put ffff9f0fc1489800/13ee1651-c170-427a-b389-1f9d341ed790 00000001:00100000:3.0:1789683537.020157:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec036ece-1720-411a-849c-c978dbb41f8a 00000001:00080000:3.0:1789683537.020162:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1789683537.020170:0:6500:0:(genops.c:885:class_export_put()) final put ffff9f0e82750800/ec036ece-1720-411a-849c-c978dbb41f8a 00000020:00000080:0.0:1789683537.020220:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc1489800/13ee1651-c170-427a-b389-1f9d341ed790 for lustre-MDT0000 00000020:00000080:0.0:1789683537.020251:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82750800/ec036ece-1720-411a-849c-c978dbb41f8a for lustre-MDT0000 00000020:00000080:0.0:1789683537.020274:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fc148a000 for lustre-MDT0000 00000020:00000080:0.0:1789683537.020277:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fb613a800 for lustre-MDT0000 00000020:01000000:2.0:1789683537.438962:0:15211:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0e835fa780 - data ffff9f0faff19a20/ffff9f0fbfbf5800 00000020:01000000:2.0:1789683537.439170:0:15211:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0f92f5c2a0 - data ffff9f0fafd71360/ffff9f0fc04ea000 00000001:00000004:2.0:1789683537.445650:0:15211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:1.0:1789683537.525656:0:15211:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789683537.525667:0:15211:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1789683537.525684:0:15211:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9f0fb61f1880 x1876618850237824/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789683545 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683537.525711:0:15211:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789683537.531188:0:15211:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789683537.531201:0:15211:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:3.0:1789683537.531230:0:15211:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789683537.531233:0:15211:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789683537.531878:0:8674:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789683537.531884:0:8674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1789683537.531896:0:8674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789683537.532669:0:15211:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789683537.532676:0:15211:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1789683537.532706:0:15211:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789683537.532709:0:15211:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789683537.533906:0:9860:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789683537.533915:0:9860:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1789683537.533929:0:9860:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789683537.537366:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889182 00000020:00000080:3.0:1789683537.537382:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0f88c6e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789683537.541966:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f88c6e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789683537.544108:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889197 00000020:00000080:3.0:1789683537.544123:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0fb240c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789683537.544133:0:15211:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789683537.544138:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683537.544147:0:15211:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789683537.544151:0:15211:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9f0fa7198000) has no exports 00000004:01000000:3.0:1789683537.544334:0:15211:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789683537.544342:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8895cd 00000020:00000080:3.0:1789683537.544347:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0e83c37000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789683537.544351:0:15211:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789683537.544354:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683537.544363:0:15211:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789683537.544365:0:15211:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff9f0e83c2cd40) has no exports 00000020:00000080:3.0:1789683537.544372:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8895c6 00000020:00000080:3.0:1789683537.544375:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0e83c31800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789683537.544521:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb240c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1789683537.544536:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83c37000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789683537.544541:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83c31800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789683537.545187:0:15211:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789683537.545193:0:15211:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789683537.545197:0:15211:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1789683537.545203:0:15211:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789683537.545206:0:15211:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789683537.545247:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789683537.545257:0:15211:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789683537.545263:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88948b 00000020:00000080:3.0:1789683537.545270:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0e81fa9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789683537.545275:0:15211:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789683537.545280:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683537.545285:0:15211:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789683537.545288:0:15211:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9f0e8240cd40) has no exports 00000020:00000080:3.0:1789683537.545293:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889484 00000020:00000080:3.0:1789683537.545296:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0e82751000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789683537.545656:0:15211:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789683537.545660:0:15211:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789683537.545673:0:15211:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:3.0:1789683537.545677:0:15211:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789683537.545679:0:15211:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789683537.545703:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789683537.545710:0:15211:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1789683537.546298:0:15211:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789683537.546307:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88933b 00000020:00000080:3.0:1789683537.546313:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0fb62cf800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789683537.546319:0:15211:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1789683537.546325:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683537.546330:0:15211:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789683537.546333:0:15211:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9f0fb504cd40) has no exports 00000020:00000080:3.0:1789683537.546338:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889334 00000020:00000080:3.0:1789683537.546341:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0fc1203000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789683537.547049:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e83c36000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789683537.547062:0:499:0:(genops.c:885:class_export_put()) final put ffff9f0fc1206800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789683537.547064:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc1206800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789683537.547070:0:499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789683537.547147:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e81fa9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789683537.547154:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82751000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789683537.547159:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fc17f3800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789683537.547163:0:499:0:(genops.c:885:class_export_put()) final put ffff9f0e82756000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789683537.547166:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82756000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789683537.547169:0:499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789683537.547196:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb62cf800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789683537.547201:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc1203000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789683537.552032:0:15211:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1789683537.552042:0:15211:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789683537.552046:0:15211:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1789683537.552056:0:15211:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789683537.552117:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683537.552133:0:15211:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789683537.552170:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683537.552174:0:15211:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789683537.552180:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0f88c68000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789683537.552185:0:15211:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f88c68000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789683537.552194:0:15211:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789683537.552306:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88919e 00000020:00000080:2.0:1789683537.552314:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0fb240c800/lustre-MDD0000_UUID 00000020:01000000:2.0:1789683537.552319:0:15211:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789683537.552323:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789683537.552329:0:15211:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789683537.552333:0:15211:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9f0fa719b380) has no exports 00000020:00000080:2.0:1789683537.552352:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683537.552355:0:15211:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789683537.552360:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8891a5 00000020:00000080:2.0:1789683537.552376:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0fb240f000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789683537.552385:0:15211:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0f8bdba800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1789683537.552388:0:15211:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0f8bdba800 3 00000020:01000004:2.0:1789683537.552391:0:15211:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0f8bdba800 from lustre-MDT0000 00000020:00000080:2.0:1789683537.552410:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683537.552414:0:15211:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789683537.552417:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0f88c69800/lustre-MDT0000_UUID 00000020:00000080:2.0:1789683537.552419:0:15211:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f88c69800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789683537.552428:0:15211:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1789683537.552460:0:15211:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1789683537.552464:0:15211:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789683537.552467:0:15211:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789683537.552469:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789683537.552484:0:15211:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789683537.552492:0:15211:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9f0f8908f000 e97b3c51-c653-4f2f-8e95-54cfcf70f127 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789683537.552498:0:15211:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9f0f86184d40) has exports, disconnecting them 00000020:00080000:2.0:1789683537.552503:0:15211:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9f0f8908f000), last request at 1789683265 00000020:00000080:2.0:1789683537.552520:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889143 00000020:00010000:2.0:1789683537.552524:0:15211:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9f0f8908f000: total 2 00000100:00080000:2.0:1789683537.552528:0:15211:0:(import.c:65:import_set_state_nolock()) ffff9f0f8908c800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789683537.552545:0:15211:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0f8908f000): rc 0 00000020:00080000:2.0:1789683537.552549:0:15211:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9f0f86184d40) has no exports 00000020:00000080:1.0:1789683537.552746:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fc1207000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789683537.552761:0:499:0:(genops.c:885:class_export_put()) final put ffff9f0fc1200800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789683537.552770:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc1200800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789683537.552775:0:499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789683537.552850:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb240c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789683537.552854:0:499:0:(genops.c:885:class_export_put()) final put ffff9f0f88c6f800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789683537.552857:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f88c6f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789683537.552860:0:499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789683537.552883:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb240f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1789683537.552916:0:6516:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9f0f890c8600:6516] 2 exiting: rc = 0 00000100:00100000:1.0:1789683537.553020:0:6514:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9f0f890c9000:6514] 0 exiting: rc = 1 00000020:00010000:0.0:1789683537.553160:0:9527:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9f0f8908f000: total 0 00010000:00010000:0.0:1789683537.553199:0:9527:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0f8908f000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789683537.553231:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f829e1800/0xcf8485587b889660 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b889659 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683537.553246:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f829e0c00/0xcf8485587b88966e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b889667 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683537.553256:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f80031200/0xcf8485587b88968a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b889683 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683537.553266:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f80030a00/0xcf8485587b88923f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b889238 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683537.553278:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f9e00/0xcf8485587b88967c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b889675 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683537.553301:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb7a31000/0xcf8485587b8898e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b8898dd expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683537.553310:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f829e0e00/0xcf8485587b889698 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b889691 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683537.553322:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f80030e00/0xcf8485587b88924d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b889246 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683537.553335:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81677600/0xcf8485587b889564 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88955d expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683537.553347:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837db000/0xcf8485587b8898f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b8898eb expref: 5 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683537.553357:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f8454c400/0xcf8485587b8896c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b8896bb expref: 4 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683537.553367:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f829e1000/0xcf8485587b889652 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b88964b expref: 3 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683537.553379:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f8454d200/0xcf8485587b889900 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf8485587b8898f9 expref: 2 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683537.553388:0:9527:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0f8908f000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1789683537.553404:0:9527:0:(genops.c:885:class_export_put()) final put ffff9f0f8908f000/e97b3c51-c653-4f2f-8e95-54cfcf70f127 00010000:00010000:0.0:1789683537.553425:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683537.553427:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683537.553429:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683537.553461:0:6515:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9f0f845b3a00:6515] 1 exiting: rc = 0 00000100:00100000:2.0:1789683537.553677:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553685:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553690:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553696:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553701:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553706:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553711:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553717:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553731:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553737:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553749:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553754:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553759:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553764:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553769:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553775:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553800:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553808:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553819:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553873:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553879:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553885:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553890:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553895:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553901:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553908:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553914:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553920:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553925:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553930:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553945:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553952:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553957:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553962:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553968:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553974:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553979:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553984:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553989:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553994:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.553999:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554004:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554009:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554013:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554018:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554033:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554038:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554044:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554051:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554056:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554061:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554067:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554072:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554077:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554083:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554089:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554095:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554101:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554106:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554112:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554118:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554124:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554130:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683537.554136:0:15211:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789683537.554769:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f8908f000/e97b3c51-c653-4f2f-8e95-54cfcf70f127 for MGS 00000020:00000080:1.0:1789683537.554829:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0f8908c800 for MGS 00000020:01000000:1.0:1789683537.555994:0:15211:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0e835fa360 - data ffff9f0fafef8948/ffff9f0fbfbf6000 00000020:01000000:1.0:1789683537.556123:0:15211:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0f92f5cc60 - data ffff9f0f8b095360/ffff9f0f881cf000 00000020:00000080:1.0:1789683537.556610:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889127 00000020:00000080:1.0:1789683537.556621:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0f85548000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789683537.556644:0:15211:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0f8bdba800 from MGS, refs=2 00000020:01000004:1.0:1789683537.556648:0:15211:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0f8bdba800 2 00000020:01000004:1.0:1789683537.556652:0:15211:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0f8bdba800 from MGS 00000020:00000080:1.0:1789683537.556677:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683537.556683:0:15211:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789683537.556686:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0f8554f800/MGS 00000020:00000080:1.0:1789683537.556688:0:15211:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f8554f800/MGS for MGS 00000020:01000000:1.0:1789683537.556694:0:15211:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789683537.556778:0:15211:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789683537.556812:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683537.556819:0:15211:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789683537.556827:0:15211:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9f0f88c58000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789683537.556834:0:15211:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9f0fa5088000) has exports, disconnecting them 00000020:00080000:1.0:1789683537.556840:0:15211:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9f0f88c58000), last request at 1789683266 00000020:00000080:1.0:1789683537.556860:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8891f2 00000020:00080000:1.0:1789683537.556871:0:15211:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0f88c58000): rc 0 00000020:00000080:1.0:1789683537.556876:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0f88c58000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789683537.557560:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f85548000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789683537.557569:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f88c58000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789683537.562114:0:15211:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789683537.562124:0:15211:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789683537.562129:0:15211:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789683537.562137:0:15211:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789683537.562174:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0f88c5d000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789683537.562352:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683537.562361:0:15211:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789683537.562368:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0f88c59800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789683537.562372:0:15211:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f88c59800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789683537.562379:0:15211:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789683537.562466:0:15211:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0f8bdba800 1 00000020:00000080:2.0:1789683537.562497:0:15211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889119 00000020:00000080:2.0:1789683537.562505:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0f8554f000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789683537.562514:0:15211:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789683537.562522:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f8554f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789683537.562532:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789683537.562537:0:15211:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789683537.562541:0:15211:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9f0fa71999c0) has no exports 00000020:00000080:2.0:1789683537.911313:0:15211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683537.911329:0:15211:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789683537.911335:0:15211:0:(genops.c:885:class_export_put()) final put ffff9f0f8bdb9800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789683537.911340:0:15211:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f8bdb9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789683537.911347:0:15211:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789683537.911543:0:15211:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f0f8bdba000 00000020:02000400:2.0:1789683537.911620:0:15211:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789683537.971322:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683538.015422:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683538.015446:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850239872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683538.015530:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683538.015724:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850239872 00000100:00100000:1.0:1789683538.015731:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850239872 00000100:00100000:1.0:1789683538.015819:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789683538.015829:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850239872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789683538.015860:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789683538.015909:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850239872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683538.015916:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789683538.015973:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850239872:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789683538.016256:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789683538.975044:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683540.000818:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683540.065938:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683540.065959:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850240000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789683540.066022:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683540.066077:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850240000 00000100:00100000:0.0:1789683540.066084:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850240000 00000100:00100000:0.0:1789683540.066131:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789683540.066139:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850240000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789683540.066167:0:8441:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789683540.066206:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850240000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683540.066213:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1789683540.066232:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683540.066268:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850240000:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789683540.575143:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789683540.575150:0:499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789683540.575153:0:499:0:(import.c:65:import_set_state_nolock()) ffff9f0f88c69000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683540.575161:0:499:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 449 00000100:00080000:3.0:1789683540.575167:0:499:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789683540.575179:0:499:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f0f88c69000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683540.575201:0:499:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb7961880 x1876618850240256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683540.575221:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789683540.575224:0:499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789683540.575233:0:499:0:(import.c:65:import_set_state_nolock()) ffff9f0fc1205800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683540.575237:0:499:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 449 00000100:00080000:3.0:1789683540.575240:0:499:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789683540.575245:0:499:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f0fc1205800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683540.575261:0:499:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb79b7800 x1876618850240384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683540.575271:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789683540.575274:0:499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789683540.575276:0:499:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5158000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683540.575279:0:499:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 449 00000100:00080000:3.0:1789683540.575282:0:499:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789683540.575285:0:499:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f0fb5158000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683540.575295:0:499:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb79b5180 x1876618850240512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683540.575328:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789683540.575331:0:499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789683540.575333:0:499:0:(import.c:65:import_set_state_nolock()) ffff9f0e83442000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683540.575336:0:499:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 449 00000100:00080000:3.0:1789683540.575338:0:499:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789683540.575342:0:499:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f0e83442000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683540.575353:0:499:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb79b7100 x1876618850240896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789683540.575392:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850241024:0@lo:400:kworker.0 00000100:00100000:3.0:1789683540.575503:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.575564:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683540.575570:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850240128:0@lo:400:kworker.0 00000400:00000100:3.0:1789683540.575590:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876618850240128 offset 0 length 224: 4 00000100:00100000:3.0:1789683540.575616:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850240256:0@lo:38:kworker.0 00000100:00100000:3.0:1789683540.575640:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.575657:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876618850240384:0@lo:38:kworker.0 00000100:00100000:3.0:1789683540.575675:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.575691:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1876618850240512:0@lo:38:kworker.0 00000100:00100000:3.0:1789683540.575722:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.575740:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1876618850240896:0@lo:38:kworker.0 00000100:00100000:3.0:1789683540.575759:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.575819:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850240640:0@lo:400:kworker.0 00000100:00100000:3.0:1789683540.575843:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.575862:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683540.575867:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850240768:0@lo:400:kworker.0 00000100:00100000:3.0:1789683540.575904:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.575935:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850241024 00000100:00100000:3.0:1789683540.575944:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850241024 00000100:00100000:3.0:1789683540.575988:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850240384 00000100:00100000:3.0:1789683540.575991:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850240384 00000100:00100000:3.0:1789683540.575999:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850240512 00000100:00100000:3.0:1789683540.576001:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850240512 00000100:00100000:3.0:1789683540.576008:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850240896 00000100:00100000:3.0:1789683540.576010:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850240896 00000100:00100000:3.0:1789683540.576016:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850240640 00000100:00100000:3.0:1789683540.576017:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850240640 00000100:00100000:3.0:1789683540.576033:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789683540.576041:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850241024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683540.576099:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876618850241024:12345-0@lo:400:kworker.0 Request processed in 58us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683540.576107:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789683540.576122:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789683540.576129:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850240640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683540.576159:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850240640:12345-0@lo:400:kworker.0 Request processed in 31us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683540.576165:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789683540.576176:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789683540.576180:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1876618850240384:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789683540.576197:0:6523:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789683540.576225:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1876618850240384:12345-0@lo:38:kworker.0 Request processed in 44us (549us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789683540.576230:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789683540.576240:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789683540.576244:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1876618850240512:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789683540.576253:0:6523:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789683540.576274:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1876618850240512:12345-0@lo:38:kworker.0 Request processed in 28us (552us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789683540.576279:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789683540.576288:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789683540.576291:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1876618850240896:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789683540.576301:0:6523:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789683540.576322:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1876618850240896:12345-0@lo:38:kworker.0 Request processed in 29us (562us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789683540.576333:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789683540.576353:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850240256 00000100:00100000:3.0:1789683540.576357:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850240256 00000100:00100000:3.0:1789683540.576374:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789683540.576379:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1876618850240256:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789683540.576389:0:6526:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789683540.576413:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1876618850240256:12345-0@lo:38:kworker.0 Request processed in 33us (772us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789683540.576433:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789683540.576463:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850240768 00000100:00100000:3.0:1789683540.576467:0:8676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850240768 00000100:00100000:3.0:1789683540.576494:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789683540.576501:0:8676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850240768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683540.576534:0:8676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850240768:12345-0@lo:400:kworker.0 Request processed in 35us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683540.576539:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:3.0:1789683540.576555:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789683540.576558:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683540.576588:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850240768:0@lo:400:kworker.0 00010000:00080000:3.0:1789683540.576600:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9f0fb79b5f80 x1876618850240640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683540.576608:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850240640:0@lo:400:kworker.0 00000100:00080000:3.0:1789683540.576632:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f88c69000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683540.576636:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789683540.576639:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850240256:0@lo:38:kworker.0 00000100:00080000:3.0:1789683540.576655:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc1205800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683540.576658:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789683540.576660:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876618850240384:0@lo:38:kworker.0 00000100:00080000:3.0:1789683540.576668:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5158000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683540.576670:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789683540.576672:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1876618850240512:0@lo:38:kworker.0 00000100:00080000:3.0:1789683540.576678:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83442000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683540.576681:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789683540.576684:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1876618850240896:0@lo:38:kworker.0 00010000:00080000:3.0:1789683540.576716:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9f0fb79b4380 x1876618850241024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683540.576724:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850241024:0@lo:400:kworker.0 00010000:00010000:3.0:1789683541.024202:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789683541.869559:0:15411:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789683541.890100:0:15411:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789683541.890171:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b889683 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88968a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.890188:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b889683 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88968a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.890196:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b889683 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88968a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.890203:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b889683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88968a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.890251:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789683541.890257:0:15411:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789683541.890287:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789683541.890291:0:15411:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789683541.890297:0:15411:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789683541.890303:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9f0fc1205800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789683541.890308:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789683541.890310:0:15411:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789683541.890312:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789683541.891423:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b889691 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889698 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891437:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b889691 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889698 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891442:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b889691 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b889698 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891448:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b889691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b889698 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891466:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789683541.891472:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1600/0xcf8485587b88955d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889564 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891479:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1600/0xcf8485587b88955d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889564 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891500:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1600/0xcf8485587b88955d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b889564 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891507:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1600/0xcf8485587b88955d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b889564 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891530:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789683541.891537:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b8898f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889900 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891543:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b8898f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889900 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891548:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b8898f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b889900 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891554:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b8898f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b889900 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891567:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1789683541.891584:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789683541.891603:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b889683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88968a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891610:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f80030c00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683541.891614:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b889683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88968a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891624:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b889683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88968a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683541.891640:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b889683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88968a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683541.891646:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789683541.891649:0:9527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789683541.891651:0:9527:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789683541.891690:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b889683 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88968a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891696:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683541.891723:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b889683 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88968a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891730:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f80030c00/0xcf8485587b889683 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88968a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891745:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789683541.891748:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b889691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b889698 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891753:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9800 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683541.891756:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b889691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b889698 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891764:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b889691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b889698 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683541.891770:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b889691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b889698 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683541.891837:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789683541.891839:0:9527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1789683541.891856:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b889691 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b889698 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891862:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683541.891879:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b889691 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b889698 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891886:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9800/0xcf8485587b889691 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b889698 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891896:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683541.891900:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1600/0xcf8485587b88955d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b889564 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891905:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f829e1600 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683541.891907:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1600/0xcf8485587b88955d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b889564 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891915:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1600/0xcf8485587b88955d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b889564 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683541.891921:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1600/0xcf8485587b88955d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b889564 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683541.891926:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789683541.891927:0:9527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789683541.891929:0:9527:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789683541.891954:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1600/0xcf8485587b88955d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b889564 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891960:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683541.891967:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1600/0xcf8485587b88955d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b889564 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891974:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1600/0xcf8485587b88955d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b889564 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891988:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683541.891991:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b8898f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b889900 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.891996:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31e00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683541.891999:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b8898f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b889900 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.892006:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b8898f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b889900 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683541.892012:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b8898f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b889900 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683541.892017:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789683541.892019:0:9527:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789683541.892020:0:9527:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789683541.892030:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b8898f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b889900 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.892035:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683541.892042:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b8898f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b889900 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.892055:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb7a31e00/0xcf8485587b8898f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b889900 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.892063:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683541.892065:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683541.892067:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683541.892091:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850241152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683541.892170:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683541.892232:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683541.892239:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850241536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683541.892264:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683541.892302:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850241280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683541.892321:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683541.892336:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683541.892341:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850241408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683541.892356:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789683541.892383:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b889246 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88924d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.892392:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b889246 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88924d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.892415:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b889246 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88924d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.892421:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b889246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88924d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.892443:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789683541.892447:0:15411:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1789683541.892450:0:15411:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:3.0:1789683541.892482:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683541.892487:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b889246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88924d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.892494:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9000 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683541.892497:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b889246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88924d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.892503:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b889246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88924d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683541.892510:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b889246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88924d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683541.892515:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789683541.892517:0:9527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789683541.892519:0:9527:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789683541.892537:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b889246 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88924d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.892543:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683541.892557:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b889246 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88924d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.892563:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b889246 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf8485587b88924d expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683541.892587:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683541.892589:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683541.892591:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683541.892598:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683541.892607:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850241664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683541.892632:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1789683541.892667:0:15411:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789683541.892671:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789683541.892676:0:15411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683541.892682:0:15411:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789683541.892687:0:15411:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9f0fb6359000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789683541.892692:0:15411:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9f0e81fae800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789683541.892697:0:15411:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9f0fc04d99c0) has exports, disconnecting them 00000020:00080000:3.0:1789683541.892701:0:15411:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9f0fb6359000), last request at 1789683540 00000020:00000080:3.0:1789683541.892708:0:15411:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889525 00000100:00080000:3.0:1789683541.892727:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9f0fb635d000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789683541.892761:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789683541.892778:0:15411:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0fb6359000): rc 0 00000020:00000080:3.0:1789683541.892780:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0fb6359000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1789683541.892821:0:15411:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9f0e81fae800), last request at 1789683540 00000020:00000080:3.0:1789683541.892825:0:15411:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8893ff 00000100:00080000:3.0:1789683541.892830:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9f0e81faf800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789683541.892847:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb6359000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1789683541.892902:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fb635d000 for lustre-MDT0001 00010000:00010000:3.0:1789683541.892912:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789683541.892921:0:15411:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0e81fae800): rc 0 00000020:00000080:3.0:1789683541.892923:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0e81fae800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789683541.892945:0:15411:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffba8340d4bae0 00000020:00000080:3.0:1789683541.892959:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e81fae800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1789683541.892985:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e81faf800 for lustre-MDT0001 00000100:00080000:3.0:1789683541.893005:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789683541.893009:0:15411:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:2.0:1789683541.893822:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683541.893840:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850241152 00000100:00100000:2.0:1789683541.893850:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850241152 00000100:00100000:2.0:1789683541.893899:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850241536 00000100:00100000:2.0:1789683541.893903:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850241536 00000100:00100000:2.0:1789683541.893914:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850241280 00000100:00100000:2.0:1789683541.893917:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850241280 00000100:00100000:2.0:1789683541.893928:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850241408 00000100:00100000:2.0:1789683541.893931:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850241408 00000100:00100000:2.0:1789683541.893939:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850241664 00000100:00100000:2.0:1789683541.893942:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850241664 00000100:00100000:2.0:1789683541.893958:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789683541.893982:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f84444450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3650:x1876618850241152:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789683541.893992:0:6506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789683541 with bad export cookie 14953223277853053251 00010000:00010000:0.0:1789683541.897300:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683541.898463:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683541.898493:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789683541.898506:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1876618850241536:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789683541.898516:0:10343:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789683541 with bad export cookie 14953223277853053251 00000100:00100000:1.0:1789683541.898622:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1876618850241536:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (6357us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789683541.898631:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789683541.898660:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789683541.898665:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1876618850241280:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789683541.898669:0:10343:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789683541 with bad export cookie 14953223277853053251 00000100:00100000:1.0:1789683541.898703:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1876618850241280:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (6381us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789683541.898709:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789683541.898738:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789683541.898743:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1876618850241408:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789683541.898748:0:10343:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789683541 with bad export cookie 14953223277853053251 00000100:00100000:1.0:1789683541.898899:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1876618850241408:12345-0@lo:103:ldlm_bl.0 Request processed in 38us (6425us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789683541.898907:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789683541.898924:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789683541.898929:0:10343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1876618850241664:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789683541.898934:0:10343:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789683541 with bad export cookie 14953223277853053251 00000100:00100000:1.0:1789683541.899155:0:10343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1876618850241664:12345-0@lo:103:ldlm_bl.0 Request processed in 223us (6520us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789683541.899164:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1789683541.899224:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789683541.899229:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9f0fa50cb000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789683541.899234:0:3647:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.150@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789683541.899557:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789683541.903855:0:15411:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789683541.903947:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9f0f88c69000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789683541.904265:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789683541.904272:0:15411:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1789683541.904292:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789683541.904382:0:15411:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789683541.904426:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9f0fc17f1800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789683541.904443:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789683541.904445:0:15411:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1789683541.904460:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789683541.904556:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850241792:0@lo:9:umount.0 00000100:00100000:3.0:1789683541.904632:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789683541.904685:0:15411:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789683541.904695:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9f0fc1205000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789683541.904714:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850241920:0@lo:9:umount.0 00000100:00100000:3.0:1789683541.904738:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683541.905696:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f84444450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3650:x1876618850241152:12345-0@lo:103:ldlm_bl.0 Request processed in 11727us (13523us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789683541.905708:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000020:00080000:3.0:1789683541.906348:0:15411:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9f0fc04d99c0) has no exports 00000100:00100000:3.0:1789683541.909137:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850241792 00000100:00100000:3.0:1789683541.909153:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850241792 00000100:00100000:3.0:1789683541.909214:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850241920 00000100:00100000:3.0:1789683541.909218:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850241920 00000100:00100000:3.0:1789683541.909246:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789683541.909256:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876618850241792:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789683541.909306:0:8440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88944c 00000100:00080000:3.0:1789683541.909318:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9f0f88c6f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789683541.909361:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:3.0:1789683541.909553:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3646:x1876618850241792:12345-0@lo:9:umount.0 Request processed in 298us (4920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683541.909561:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789683541.909578:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789683541.909584:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876618850241920:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789683541.909596:0:8440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88958e 00000100:00080000:3.0:1789683541.909603:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9f0fb635d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789683541.909630:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789683541.909719:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3646:x1876618850241920:12345-0@lo:9:umount.0 Request processed in 134us (4978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683541.909726:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1789683541.909776:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:2.0:1789683541.911174:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683541.913656:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789683541.921459:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc1205000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789683541.921473:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789683541.921475:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789683541.921482:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850241920:0@lo:9:umount.0 00000100:00080000:2.0:1789683541.921499:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc17f1800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789683541.921515:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789683541.921517:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789683541.921520:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850241792:0@lo:9:umount.0 00000100:00080000:1.0:1789683541.924102:0:3647:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.150@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789683541.924107:0:3647:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789683541.924116:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fb7961f80 x1876618850240128/t0(0) o400->MGC192.168.201.150@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789683556 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683541.924130:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fb79b4380 x1876618850241152/t0(0) o103->MGC192.168.201.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789683557 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683541.924141:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fb79b7800 x1876618850241536/t0(0) o103->MGC192.168.201.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789683557 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683541.924149:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fb79b7100 x1876618850241280/t0(0) o103->MGC192.168.201.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789683557 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683541.924157:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fb79b5180 x1876618850241408/t0(0) o103->MGC192.168.201.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789683557 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683541.924182:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fb79b5c00 x1876618850241664/t0(0) o103->MGC192.168.201.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789683557 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789683541.924190:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789683541.924193:0:3647:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789683541.924194:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789683541.924325:0:3650:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9f0fa50cb000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1789683541.924367:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850241152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683541.924402:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3650:1876618850241536:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789683541.924569:0:3649:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9f0fa50cb000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1789683541.924584:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850240128:0@lo:400:kworker.0 00000100:00100000:3.0:1789683541.924599:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3649:1876618850241664:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789683541.925050:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9f0fa50cb000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683541.925056:0:3647:0:(import.c:545:import_select_connection()) MGC192.168.201.150@tcp: connect to NID 0@lo last attempt 179 00000100:00080000:1.0:1789683541.925071:0:3647:0:(import.c:666:import_select_connection()) MGC192.168.201.150@tcp: import ffff9f0fa50cb000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683541.925109:0:3647:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb799b100 x1876618850242048/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683541.925144:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850241280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683541.925158:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3647:1876618850241408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683541.925216:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3646:1876618850242048:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1789683541.925261:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876618850242048 offset 0 length 520: 4 00000020:00080000:3.0:1789683541.937338:0:15411:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9f0fc04d99c0) has no exports 00000020:01000000:2.0:1789683541.985954:0:15411:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0e835faf00 - data ffff9f0faff18a20/ffff9f0fbfbf4000 00000020:01000000:2.0:1789683541.986198:0:15411:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0f92f5c900 - data ffff9f0fafc4f798/ffff9f0fc1125000 00000001:00000004:2.0:1789683541.995353:0:15411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:0.0:1789683542.055140:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789683542.070243:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789683542.070255:0:15411:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789683542.070266:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789683542.080224:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789683542.080234:0:15411:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1789683542.080251:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789683542.080254:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789683542.080557:0:8670:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789683542.080563:0:8670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1789683542.080572:0:8670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789683542.092326:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789683542.092334:0:15411:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1789683542.092354:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789683542.092357:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789683542.092664:0:9852:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789683542.092670:0:9852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1789683542.092690:0:9852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789683542.097369:0:15411:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889269 00000020:00000080:2.0:1789683542.097386:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0fb5159800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789683542.101508:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb5159800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789683542.102330:0:15411:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88927e 00000020:00000080:2.0:1789683542.102342:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0fb5180000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789683542.102357:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1789683542.102362:0:15411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789683542.102385:0:15411:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789683542.102389:0:15411:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9f0fc04db380) has no exports 00000004:01000000:2.0:1789683542.102576:0:15411:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789683542.102585:0:15411:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889587 00000020:00000080:2.0:1789683542.102590:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0fb635a000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789683542.102594:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789683542.102598:0:15411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789683542.102605:0:15411:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789683542.102608:0:15411:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff9f0e837ab380) has no exports 00000020:00000080:2.0:1789683542.102613:0:15411:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889580 00000020:00000080:2.0:1789683542.102617:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0fc1201000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789683542.102780:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb5180000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1789683542.102810:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb635a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789683542.102815:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc1201000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789683542.107111:0:15411:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1789683542.107121:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789683542.107125:0:15411:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:0.0:1789683542.107133:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789683542.107136:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789683542.107228:0:15411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789683542.107242:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789683542.107252:0:15411:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889445 00000020:00000080:0.0:1789683542.107262:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0e82755000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789683542.117501:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fc1205000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789683542.117531:0:499:0:(genops.c:885:class_export_put()) final put ffff9f0e81fa8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789683542.117535:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e81fa8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1789683542.117568:0:499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789683542.119035:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1789683542.119047:0:15411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789683542.119061:0:15411:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789683542.119067:0:15411:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9f0e82408000) has no exports 00000020:00000080:0.0:1789683542.119077:0:15411:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88943e 00000020:00000080:0.0:1789683542.119086:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0fc17f5800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1789683542.119511:0:15411:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1789683542.119517:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789683542.119522:0:15411:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1789683542.119527:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789683542.119529:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789683542.119577:0:15411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789683542.119584:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1789683542.119608:0:15411:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789683542.119616:0:15411:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8892a1 00000020:00000080:0.0:1789683542.119621:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0fc1374000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789683542.119627:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1789683542.119630:0:15411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789683542.119634:0:15411:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789683542.119637:0:15411:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9f0fc1243380) has no exports 00000020:00000080:0.0:1789683542.119641:0:15411:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88929a 00000020:00000080:0.0:1789683542.119644:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0f88c6c000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789683542.119884:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82755000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789683542.119894:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc17f5800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789683542.119899:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fc17f1800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789683542.119905:0:499:0:(genops.c:885:class_export_put()) final put ffff9f0fc17f7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789683542.119907:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc17f7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1789683542.119911:0:499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789683542.119985:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc1374000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789683542.120000:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f88c6c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1789683542.124924:0:15411:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1789683542.124932:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789683542.124936:0:15411:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1789683542.124945:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789683542.125000:0:15411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683542.125011:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789683542.125046:0:15411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683542.125050:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789683542.125055:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0fb515d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789683542.125059:0:15411:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb515d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1789683542.125066:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789683542.125233:0:15411:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889285 00000020:00000080:1.0:1789683542.125240:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0fb5182800/lustre-MDD0001_UUID 00000020:01000000:1.0:1789683542.125245:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1789683542.125249:0:15411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683542.125254:0:15411:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789683542.125258:0:15411:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9f0fc04d8000) has no exports 00000020:00000080:1.0:1789683542.125276:0:15411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683542.125279:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1789683542.125283:0:15411:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88928c 00000020:00000080:1.0:1789683542.125287:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0fb5185800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1789683542.125295:0:15411:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0f88c59000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1789683542.125298:0:15411:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0f88c59000 2 00000020:01000004:1.0:1789683542.125301:0:15411:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0f88c59000 from lustre-MDT0001 00000020:00000080:1.0:1789683542.125316:0:15411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683542.125319:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1789683542.125321:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0fb515a000/lustre-MDT0001_UUID 00000020:00000080:1.0:1789683542.125323:0:15411:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb515a000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1789683542.125330:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1789683542.125358:0:15411:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1789683542.125373:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1789683542.125375:0:15411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683542.125379:0:15411:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789683542.125385:0:15411:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9f0fc1375000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789683542.125400:0:15411:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9f0fa508cd40) has exports, disconnecting them 00000020:00080000:1.0:1789683542.125405:0:15411:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9f0fc1375000), last request at 1789683303 00000020:00000080:1.0:1789683542.125409:0:15411:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8892e0 00000020:00080000:1.0:1789683542.125421:0:15411:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0fc1375000): rc 0 00000020:00000080:1.0:1789683542.125424:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0fc1375000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789683542.125637:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0f88c69000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1789683542.125646:0:36:0:(genops.c:885:class_export_put()) final put ffff9f0fb240a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789683542.125648:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb240a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1789683542.125657:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789683542.125747:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb5182800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1789683542.125751:0:36:0:(genops.c:885:class_export_put()) final put ffff9f0fb5158800/lustre-MDD0001_UUID 00000020:00000080:2.0:1789683542.125753:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb5158800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1789683542.125757:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1789683542.125947:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb5185800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789683542.125951:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc1375000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1789683542.158897:0:15411:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1789683542.158907:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789683542.158912:0:15411:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789683542.158920:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789683542.158951:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fc1205800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789683542.159125:0:15411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683542.159133:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1789683542.159138:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0fc1204800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1789683542.159142:0:15411:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc1204800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1789683542.159161:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1789683542.159227:0:15411:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0f88c59000 1 00000020:00000080:2.0:1789683542.159232:0:15411:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88921c 00000020:00000080:2.0:1789683542.159239:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0fb240b800/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1789683542.159246:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1789683542.159253:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb240b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789683542.159260:0:15411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789683542.159264:0:15411:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789683542.159268:0:15411:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9f0f86183380) has no exports 00000020:00000080:2.0:1789683542.266231:0:15411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683542.266247:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1789683542.266254:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0f88c5b800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789683542.266259:0:15411:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0f88c5b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1789683542.266265:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1789683542.266635:0:15411:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f0f88c5c000 00000020:01000000:2.0:1789683542.266657:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789683542.266662:0:15411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789683542.266667:0:15411:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789683542.266671:0:15411:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9f0fa50899c0) has no exports 00000100:00100000:2.0:1789683542.266873:0:8462:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9f0e81d44800:8462] 3 exiting: rc = 0 00000100:00100000:3.0:1789683542.266917:0:6523:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9f0f890e4000:6523] 2 exiting: rc = 0 00000100:00100000:2.0:1789683542.267000:0:12533:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff9f0e826a7800:12533] 4 exiting: rc = 0 00000100:00100000:3.0:1789683542.267568:0:6521:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9f0fa53d1400:6521] 0 exiting: rc = 1 00000100:00100000:2.0:1789683542.270100:0:6522:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9f0fa53d1200:6522] 1 exiting: rc = 0 00000100:00100000:3.0:1789683542.270172:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270183:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270202:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270207:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270213:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270218:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270223:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270228:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270234:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270240:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270246:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270252:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270259:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270264:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270269:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270274:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270279:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270284:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270289:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270294:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270299:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270304:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270309:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270315:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270320:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270325:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270330:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270335:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270423:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270431:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270437:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270442:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270449:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270455:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270460:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270466:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270472:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270485:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270490:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270494:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270500:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270505:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270510:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270515:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270520:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270525:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270530:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270534:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270540:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270545:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270550:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270556:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270560:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270566:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270570:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270575:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270580:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270584:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270589:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270594:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270600:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270605:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270610:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.270617:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.273071:0:6524:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9f0fa5099600:6524] 0 exiting: rc = 1 00000100:00100000:3.0:1789683542.273213:0:6525:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9f0f890e5e00:6525] 1 exiting: rc = 0 00000100:00100000:3.0:1789683542.273275:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.273283:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.273289:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.273295:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.273301:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.273307:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.273328:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.273334:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.273341:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.273346:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.273351:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.273357:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.273364:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.273369:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.273374:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.273379:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.273384:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.277992:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278017:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278022:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278028:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278034:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278039:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278044:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278049:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278054:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278059:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278064:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278069:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278074:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278080:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278085:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278090:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278095:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278100:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278106:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278111:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278116:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278121:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278126:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278131:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278154:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278159:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278164:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278169:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278174:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278178:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278183:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278188:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278194:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278199:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278204:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278208:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278213:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278219:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278223:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278228:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278233:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278238:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278242:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278247:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278252:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278257:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.278263:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683542.278816:0:6526:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9f0fa53caa00:6526] 0 exiting: rc = 1 00000100:00100000:0.0:1789683542.278940:0:7879:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff9f0fb50f1600:7879] 2 exiting: rc = 0 00000100:00100000:2.0:1789683542.279090:0:6527:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9f0fa53ca400:6527] 1 exiting: rc = 0 00000100:00100000:3.0:1789683542.283660:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283700:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283712:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283719:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283726:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283732:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283739:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283745:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283752:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283757:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283763:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283778:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283814:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283822:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283830:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283837:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283843:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283849:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283855:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283861:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283867:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283874:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283880:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283902:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283909:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283917:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283925:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283933:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283941:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283946:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283952:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283958:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283963:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283969:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283974:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.283994:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284002:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284008:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284013:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284019:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284025:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284030:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284037:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284042:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284047:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284054:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284059:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284089:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284096:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284101:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284108:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284114:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284120:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284126:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284132:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284138:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284144:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284150:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284155:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284175:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284182:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284188:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284194:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.284206:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.303048:0:6528:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9f0fa53cb600:6528] 0 exiting: rc = 1 00000100:00100000:3.0:1789683542.311339:0:6529:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9f0fa53ca800:6529] 1 exiting: rc = 0 00000100:00100000:1.0:1789683542.311598:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311608:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311613:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311620:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311626:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311631:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311636:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311641:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311646:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311652:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311658:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311663:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311669:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311675:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311680:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311684:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311689:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311693:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311698:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311703:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311708:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311712:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311717:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311738:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311744:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311750:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311755:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311759:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311764:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311769:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311774:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311779:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311804:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311810:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311816:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311821:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311827:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311833:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311838:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311843:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311849:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311853:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311859:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311864:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311869:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311874:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311880:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311886:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311890:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311895:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311900:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311906:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311910:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311915:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311921:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311927:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311932:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311937:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311951:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311956:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311961:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311966:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311971:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.311977:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312399:0:6531:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9f0fa53cbe00:6531] 1 exiting: rc = 0 00000100:00100000:3.0:1789683542.312462:0:6530:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9f0fa53cb000:6530] 0 exiting: rc = 1 00000100:00100000:1.0:1789683542.312498:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312506:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312517:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312522:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312527:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312531:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312537:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312542:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312548:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312553:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312557:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312562:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312567:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312571:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312576:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312581:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312586:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312591:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312596:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312601:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312606:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312610:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312615:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312619:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312624:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312628:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312632:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312637:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312648:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312653:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312658:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312662:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312667:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312672:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312677:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312681:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312686:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312690:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312695:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312699:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312704:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312709:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312713:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312717:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312722:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312727:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312732:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312737:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312741:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312745:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312750:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312755:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312760:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312764:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312769:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312773:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312778:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312800:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312807:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312814:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312819:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312823:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312828:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.312838:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313136:0:6532:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9f0f83605800:6532] 0 exiting: rc = 1 00000100:00100000:3.0:1789683542.313204:0:6533:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9f0f8a295a00:6533] 1 exiting: rc = 0 00000100:00100000:1.0:1789683542.313310:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313316:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313322:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313327:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313332:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313337:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313343:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313348:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313353:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313358:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313363:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313369:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313373:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313378:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313383:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313396:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313402:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313408:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313413:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313418:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313423:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313428:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313433:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313438:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313443:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313448:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313454:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313459:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313463:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313468:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313474:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313478:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313483:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313499:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313505:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313512:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313518:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313523:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313528:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313533:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313539:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313667:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313675:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313681:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313686:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313691:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313696:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313701:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313705:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313710:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313715:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313719:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313724:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313728:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313733:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313737:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313742:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313747:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313751:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313756:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313760:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313764:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313769:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.313773:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683542.314284:0:6534:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9f0f84570800:6534] 0 exiting: rc = 1 00000100:00100000:3.0:1789683542.314514:0:6536:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9f0f8a295800:6536] 2 exiting: rc = 0 00000100:00100000:3.0:1789683542.314950:0:6535:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9f0f84571800:6535] 1 exiting: rc = 0 00000100:00100000:1.0:1789683542.315025:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315032:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315037:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315043:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315056:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315062:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315068:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315073:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315080:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315086:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315092:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315097:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315103:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315108:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315114:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315119:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315123:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315129:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315134:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315139:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315145:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315151:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315156:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315162:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315178:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315184:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315191:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315197:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315202:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315207:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315213:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315218:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315223:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315229:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315234:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315240:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315244:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315249:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315254:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315263:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315269:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315275:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315281:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315286:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315291:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315297:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315302:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315308:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315398:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315474:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315481:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315487:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315492:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315498:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315503:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315510:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315712:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315718:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315724:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315729:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315735:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315741:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315746:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683542.315751:0:15411:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789683542.328196:0:15411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683542.328210:0:15411:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789683542.328216:0:15411:0:(genops.c:885:class_export_put()) final put ffff9f0fa50ca000/MDS_uuid 00000020:00000080:1.0:1789683542.328221:0:15411:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fa50ca000/MDS_uuid for MDS 00000020:01000000:1.0:1789683542.328231:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789683542.328421:0:15411:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1789683543.071103:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683544.094941:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683545.121124:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789683545.700765:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e97b3c51-c653-4f2f-8e95-54cfcf70f127->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789683545.700774:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e97b3c51-c653-4f2f-8e95-54cfcf70f127->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789683545.700777:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789683545.700781:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789683545.700807:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5158000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683545.700815:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 454 00000100:00080000:3.0:1789683545.700821:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789683545.700839:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f0fb5158000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683545.700873:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc0726300 x1876618850242176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683545.700910:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789683545.700913:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789683545.700915:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0e83442000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683545.700919:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 454 00000100:00080000:3.0:1789683545.700921:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789683545.700926:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f0e83442000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683545.700937:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc0724a80 x1876618850242432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789683545.700973:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1876618850242176:0@lo:38:kworker.0 00000400:00000100:3.0:1789683545.701025:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850242176 offset 0 length 520: 4 00000100:00100000:3.0:1789683545.701067:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1876618850242432:0@lo:38:kworker.0 00000400:00000100:3.0:1789683545.701083:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850242432 offset 0 length 520: 4 00000100:00100000:3.0:1789683545.701110:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850242560:0@lo:400:kworker.0 00000400:00000100:3.0:1789683545.701126:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850242560 offset 0 length 224: 4 00000100:00100000:3.0:1789683545.701140:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683545.701145:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850242304:0@lo:400:kworker.0 00000400:00000100:3.0:1789683545.701158:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850242304 offset 0 length 224: 4 00010000:00010000:3.0:1789683546.143155:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789683546.495413:0:15612:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789683546.537144:0:15612:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789683546.537209:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1a00/0xcf8485587b889667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88966e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683546.537227:0:15612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1a00/0xcf8485587b889667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88966e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683546.537250:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1a00/0xcf8485587b889667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88966e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683546.537269:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1a00/0xcf8485587b889667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88966e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683546.537338:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789683546.537345:0:15612:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789683546.537370:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789683546.537381:0:15612:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc0726300 x1876618850242176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789683565 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683546.537407:0:15612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789683546.537414:0:15612:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789683546.537421:0:15612:0:(import.c:65:import_set_state_nolock()) ffff9f0fb5158000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789683546.537426:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789683546.537430:0:15612:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc0726300 x1876618850242176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789683565 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683546.537438:0:15612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789683546.537441:0:15612:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:0.0:1789683546.537507:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1876618850242176:0@lo:38:kworker.0 00000100:00080000:2.0:1789683546.538533:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789683546.538545:0:15612:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc0724380 x1876618850242304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683561 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683546.538571:0:15612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789683546.538576:0:15612:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789683546.538598:0:15612:0:(import.c:65:import_set_state_nolock()) ffff9f0e810ca000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789683546.538757:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850242304:0@lo:400:kworker.0 00000100:00100000:1.0:1789683546.538995:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1876618850242688:0@lo:39:umount.0 00000400:00000100:1.0:1789683546.539228:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850242688 offset 0 length 224: 4 00010000:00010000:3.0:1789683546.539550:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683546.539561:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1a00/0xcf8485587b889667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88966e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683546.539589:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f829e1a00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683546.539651:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1a00/0xcf8485587b889667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88966e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683546.539664:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1a00/0xcf8485587b889667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88966e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683546.539671:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1a00/0xcf8485587b889667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88966e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683546.539677:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789683546.539679:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789683546.539683:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789683546.539698:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0fa50cb000 00010000:00010000:3.0:1789683546.539703:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1a00/0xcf8485587b889667 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88966e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683546.539710:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1a00/0xcf8485587b889667 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88966e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683546.539723:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683546.539725:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683546.539727:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789683546.719124:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) e97b3c51-c653-4f2f-8e95-54cfcf70f127->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789683546.719160:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) e97b3c51-c653-4f2f-8e95-54cfcf70f127->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683546.719164:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789683546.719168:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789683546.719347:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683546.719371:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850242816:0@lo:400:kworker.0 00000400:00000100:0.0:1789683546.719434:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850242816 offset 0 length 224: 4 00010000:00010000:2.0:1789683547.167004:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789683547.745489:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789683547.745497:0:9518:0:(genops.c:885:class_export_put()) final put ffff9f0fb635b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789683547.745582:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb635b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789683547.745707:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fb635d800 for lustre-OST0001 00000001:00100000:0.0:1789683547.746308:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789683547.746313:0:8433:0:(genops.c:885:class_export_put()) final put ffff9f0fc06b7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789683547.746956:0:499:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc06b7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789683547.747010:0:499:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0f88c6f000 for lustre-OST0000 00010000:00010000:2.0:1789683548.191016:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683549.215272:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683550.239285:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789683550.751425:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e97b3c51-c653-4f2f-8e95-54cfcf70f127->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789683550.751435:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e97b3c51-c653-4f2f-8e95-54cfcf70f127->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789683550.751460:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789683550.751463:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789683550.751624:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683550.751650:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850242944:0@lo:400:kworker.0 00000400:00000100:0.0:1789683550.751711:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850242944 offset 0 length 224: 4 00010000:00010000:2.0:1789683551.263097:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683551.649077:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683541/real 1789683541] req@ffff9f0fb799b100 x1876618850242048/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789683551 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683551.649113:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fb799b100 x1876618850242048/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789683551 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789683551.649132:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fa50cb000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789683551.649160:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789683551.649164:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3646:1876618850242048:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1789683551.649609:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e97b3c51-c653-4f2f-8e95-54cfcf70f127->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789683551.649615:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789683551.649618:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0fa50cb000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683551.649623:0:36:0:(import.c:545:import_select_connection()) MGC192.168.201.150@tcp: connect to NID 0@lo last attempt 455 00000100:00080000:3.0:1789683551.649629:0:36:0:(import.c:630:import_select_connection()) MGC192.168.201.150@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789683551.649641:0:36:0:(import.c:666:import_select_connection()) MGC192.168.201.150@tcp: import ffff9f0fa50cb000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683551.649672:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc0726a00 x1876618850243072/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683551.649697:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789683551.649702:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789683551.649817:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683551.649831:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850243200:0@lo:400:kworker.0 00000400:00000100:0.0:1789683551.649877:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850243200 offset 0 length 224: 4 00000100:00100000:1.0:1789683551.650617:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3646:1876618850243072:0@lo:250:kworker.0 00000400:00000100:1.0:1789683551.650647:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876618850243072 offset 0 length 520: 4 00010000:00010000:2.0:1789683552.287308:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683553.316861:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683554.335281:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683555.359833:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683556.382971:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683556.769267:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683546/real 1789683546] req@ffff9f0fa7244000 x1876618850242688/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789683556 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683556.769303:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fa7244000 x1876618850242688/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789683556 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789683556.769323:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e810ca000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789683556.769345:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1876618850242688:0@lo:39:umount.0 00000100:00080000:2.0:1789683556.769896:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789683556.769903:0:15612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789683556.769909:0:15612:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789683556.771448:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88967c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683556.771467:0:15612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88967c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683556.771474:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88967c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683556.771481:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b88967c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683556.771511:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789683556.771518:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b8898eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8898f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683556.771525:0:15612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b8898eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8898f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683556.771531:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b8898eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b8898f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683556.771536:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b8898eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b8898f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683556.771629:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789683556.771635:0:15612:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789683556.771664:0:15612:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789683556.771668:0:15612:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789683556.771674:0:15612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789683556.771679:0:15612:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789683556.771683:0:15612:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9f0fc1240000) has no exports 00000020:00080000:2.0:1789683556.771716:0:15612:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9f0fc1240000) has no exports 00010000:00010000:3.0:1789683556.774837:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683556.774853:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88967c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683556.774866:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8c00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683556.775240:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b88967c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683556.775253:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88967c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683556.775260:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88967c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683556.775287:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789683556.775291:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1789683556.775293:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1789683556.775312:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0fa50cb000 00010000:00010000:3.0:1789683556.775316:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889675 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88967c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683556.775322:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b889675 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88967c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683556.775339:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683556.775343:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b8898eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b8898f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683556.775349:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837db200 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683556.775352:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b8898eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b8898f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683556.775359:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b8898eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b8898f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683556.775364:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b8898eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b8898f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683556.775369:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789683556.775371:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789683556.775373:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789683556.775377:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0fa50cb000 00010000:00010000:3.0:1789683556.775380:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b8898eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b8898f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683556.775392:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b8898eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b8898f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683556.775401:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683556.775402:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683556.775404:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789683556.776528:0:15612:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0f8b861660 - data ffff9f0fafd41bd0/ffff9f0e82fe0000 00000020:01000000:2.0:1789683556.776675:0:15612:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0fc0526780 - data ffff9f0fafe86438/ffff9f0fb619d800 00010000:00010000:0.0:1789683556.776865:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789683556.788026:0:15612:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789683556.795841:0:15612:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8893b9 00000020:00000080:3.0:1789683556.795854:0:15612:0:(genops.c:885:class_export_put()) final put ffff9f0fa50ce800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789683556.795878:0:15612:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0fb62ea800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789683556.795882:0:15612:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0fb62ea800 2 00000020:01000004:3.0:1789683556.795885:0:15612:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0fb62ea800 from lustre-OST0000 00000020:00000080:3.0:1789683556.795915:0:15612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789683556.795924:0:15612:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789683556.795927:0:15612:0:(genops.c:885:class_export_put()) final put ffff9f0fb62eb800/lustre-OST0000_UUID 00000020:00000080:3.0:1789683556.795930:0:15612:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb62eb800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789683556.795937:0:15612:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789683556.795987:0:15612:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789683556.795992:0:15612:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789683556.795996:0:15612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683556.796001:0:15612:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789683556.796007:0:15612:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9f0fb515a800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789683556.796013:0:15612:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9f0e824099c0) has exports, disconnecting them 00000020:00080000:3.0:1789683556.796018:0:15612:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9f0fb515a800), last request at 1789683323 00000020:00000080:3.0:1789683556.796022:0:15612:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8893e3 00000020:00080000:3.0:1789683556.796031:0:15612:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0fb515a800): rc 0 00000020:00000080:3.0:1789683556.796037:0:15612:0:(genops.c:885:class_export_put()) final put ffff9f0fb515a800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789683556.796839:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fa50ce800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789683556.796855:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb515a800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789683556.797849:0:15612:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789683556.797855:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789683556.797859:0:15612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789683556.797865:0:15612:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789683556.798052:0:15612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789683556.798072:0:15612:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1789683556.798078:0:15612:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789683556.798081:0:15612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789683556.798085:0:15612:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789683556.798092:0:15612:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9f0fb515c000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789683556.798097:0:15612:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff9f0fb50499c0) has exports, disconnecting them 00000020:00080000:0.0:1789683556.798102:0:15612:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9f0fb515c000), last request at 1789683323 00000020:00000080:0.0:1789683556.798105:0:15612:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8893f8 00000020:00080000:0.0:1789683556.798120:0:15612:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0fb515c000): rc 0 00000020:00000080:0.0:1789683556.798125:0:15612:0:(genops.c:885:class_export_put()) final put ffff9f0fb515c000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789683556.799414:0:14530:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fb5158000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789683556.799429:0:14530:0:(genops.c:885:class_export_put()) final put ffff9f0fb5159000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789683556.799445:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb5159000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789683556.799459:0:14530:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789683556.799531:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb515c000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1789683556.799557:0:15612:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789683556.799561:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789683556.799565:0:15612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789683556.799569:0:15612:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789683556.799589:0:14530:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e810ca000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789683556.799814:0:15612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683556.799821:0:15612:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1789683556.799825:0:15612:0:(genops.c:885:class_export_put()) final put ffff9f0e810c9000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1789683556.799827:0:15612:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e810c9000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1789683556.799831:0:15612:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1789683556.799862:0:15612:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0fb62ea800 1 00000020:00000080:1.0:1789683556.799867:0:15612:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889381 00000020:00000080:1.0:1789683556.799883:0:15612:0:(genops.c:885:class_export_put()) final put ffff9f0fb613e800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789683556.799892:0:15612:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789683556.799899:0:14530:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb613e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789683556.799908:0:15612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683556.799912:0:15612:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789683556.799915:0:15612:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9f0fb504b380) has no exports 00000020:00000080:1.0:1789683556.910557:0:15612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683556.910572:0:15612:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789683556.910577:0:15612:0:(genops.c:885:class_export_put()) final put ffff9f0fb62ea000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789683556.910582:0:15612:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb62ea000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789683556.911075:0:15612:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789683556.911231:0:15612:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f0fb62eb000 00000020:02000400:1.0:1789683556.911296:0:15612:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:3.0:1789683556.959844:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e97b3c51-c653-4f2f-8e95-54cfcf70f127->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789683556.959855:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e97b3c51-c653-4f2f-8e95-54cfcf70f127->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789683556.959865:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789683556.959868:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789683556.959940:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683556.959962:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1876618850243328:0@lo:400:kworker.0 00000400:00000100:3.0:1789683556.960020:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850243328 offset 0 length 224: 4 00010000:00010000:2.0:1789683557.407488:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683558.433857:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683559.455566:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683560.480118:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789683560.846759:0:15814:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789683560.877009:0:15814:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789683560.877132:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbe00/0xcf8485587b88964b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889652 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683560.877150:0:15814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbe00/0xcf8485587b88964b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889652 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683560.877158:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbe00/0xcf8485587b88964b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b889652 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683560.877167:0:15814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbe00/0xcf8485587b88964b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b889652 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683560.877196:0:15814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789683560.877202:0:15814:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789683560.877241:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789683560.877257:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc0724a80 x1876618850242432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789683565 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683560.877277:0:15814:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789683560.877284:0:15814:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789683560.877290:0:15814:0:(import.c:65:import_set_state_nolock()) ffff9f0e83442000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789683560.877295:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789683560.877298:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc0724a80 x1876618850242432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789683565 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683560.877305:0:15814:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789683560.877307:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00010000:00010000:2.0:1789683560.877412:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683560.877420:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbe00/0xcf8485587b88964b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b889652 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683560.877426:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dbe00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683560.877430:0:9528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbe00/0xcf8485587b88964b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b889652 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683560.877438:0:9528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbe00/0xcf8485587b88964b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b889652 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683560.877444:0:9528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbe00/0xcf8485587b88964b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b889652 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683560.877449:0:9528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789683560.877452:0:9528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789683560.877454:0:9528:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789683560.877474:0:9528:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0fa50cb000 00010000:00010000:2.0:1789683560.877478:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbe00/0xcf8485587b88964b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b889652 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683560.877486:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0e837dbe00/0xcf8485587b88964b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b889652 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683560.877497:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683560.877498:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683560.877500:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683560.877708:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1876618850242432:0@lo:38:kworker.0 00000100:00080000:1.0:1789683560.880157:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789683560.880175:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc0726d80 x1876618850242560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683561 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683560.880197:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fb7999180 x1876618850242816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683562 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683560.880237:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc0724000 x1876618850242944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683566 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683560.880254:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc0724e00 x1876618850243200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683567 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683560.880261:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc0727480 x1876618850243328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683572 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683560.880270:0:15814:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789683560.880276:0:15814:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789683560.880306:0:15814:0:(import.c:65:import_set_state_nolock()) ffff9f0e82752000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789683560.880569:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850242816:0@lo:400:kworker.0 00000100:00100000:2.0:1789683560.880607:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1876618850243328:0@lo:400:kworker.0 00000100:00100000:0.0:1789683560.881923:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850243200:0@lo:400:kworker.0 00000100:00100000:0.0:1789683560.881934:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1876618850242560:0@lo:400:kworker.0 00000100:00100000:0.0:1789683560.881963:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1876618850242944:0@lo:400:kworker.0 00000100:00100000:0.0:1789683560.881981:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1876618850243456:0@lo:39:umount.0 00000400:00000100:0.0:1789683560.882026:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618850243456 offset 0 length 224: 4 00010000:00010000:1.0:1789683561.508181:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789683562.080637:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) e97b3c51-c653-4f2f-8e95-54cfcf70f127->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789683562.080647:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) e97b3c51-c653-4f2f-8e95-54cfcf70f127->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789683562.527781:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683563.552776:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683564.575349:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683565.599581:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683566.623354:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683567.006889:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683551/real 1789683551] req@ffff9f0fc0726a00 x1876618850243072/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789683566 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683567.006922:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fc0726a00 x1876618850243072/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789683566 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789683567.006941:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fa50cb000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683567.006993:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789683567.006998:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3646:1876618850243072:0@lo:250:kworker.0 00000100:00080000:3.0:1789683567.007121:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e97b3c51-c653-4f2f-8e95-54cfcf70f127->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789683567.007126:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789683567.007129:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0fa50cb000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683567.007134:0:36:0:(import.c:545:import_select_connection()) MGC192.168.201.150@tcp: connect to NID 0@lo last attempt 465 00000100:00080000:3.0:1789683567.007150:0:36:0:(import.c:630:import_select_connection()) MGC192.168.201.150@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789683567.007162:0:36:0:(import.c:666:import_select_connection()) MGC192.168.201.150@tcp: import ffff9f0fa50cb000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683567.007194:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc0727b80 x1876618850243584/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789683567.007341:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3646:1876618850243584:0@lo:250:kworker.0 00000400:00000100:0.0:1789683567.007390:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876618850243584 offset 0 length 520: 4 00010000:00010000:0.0:1789683567.649137:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683568.671202:0:9528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683569.696697:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683570.078932:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683560/real 1789683560] req@ffff9f0fb799b100 x1876618850243456/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789683570 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683570.078966:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fb799b100 x1876618850243456/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789683570 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789683570.078989:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e82752000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789683570.079015:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1876618850243456:0@lo:39:umount.0 00000100:00080000:1.0:1789683570.079570:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789683570.079575:0:15814:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789683570.079581:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789683570.080978:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b889660 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683570.080997:0:15814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b889660 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683570.081004:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b889660 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683570.081010:0:15814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b889660 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683570.081155:0:15814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683570.081166:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837dae00/0xcf8485587b8898dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b8898e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683570.081173:0:15814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837dae00/0xcf8485587b8898dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b8898e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683570.081178:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837dae00/0xcf8485587b8898dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b8898e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683570.081184:0:15814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff9f0e837dae00/0xcf8485587b8898dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf8485587b8898e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683570.081277:0:15814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789683570.081283:0:15814:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789683570.081312:0:15814:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789683570.081327:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789683570.081332:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683570.081338:0:15814:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789683570.081342:0:15814:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff9f0f86180000) has no exports 00000020:00080000:1.0:1789683570.081368:0:15814:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff9f0f86180000) has no exports 00010000:00010000:0.0:1789683570.081739:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683570.081749:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b889660 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683570.081757:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f829e1c00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683570.081761:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b889660 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683570.081770:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b889660 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683570.081777:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b889660 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683570.081817:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789683570.081831:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789683570.081834:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1789683570.081849:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0fa50cb000 00010000:00010000:0.0:1789683570.081853:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889659 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b889660 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683570.081860:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f829e1c00/0xcf8485587b889659 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b889660 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683570.081875:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683570.081879:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0e837dae00/0xcf8485587b8898dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b8898e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683570.081885:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dae00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683570.081888:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837dae00/0xcf8485587b8898dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf8485587b8898e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683570.081906:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0e837dae00/0xcf8485587b8898dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b8898e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683570.081912:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837dae00/0xcf8485587b8898dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b8898e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683570.081917:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789683570.081919:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789683570.081921:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789683570.081926:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0fa50cb000 00010000:00010000:0.0:1789683570.081929:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0e837dae00/0xcf8485587b8898dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b8898e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683570.081934:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0e837dae00/0xcf8485587b8898dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b8898e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683570.081955:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683570.081956:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683570.081958:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683570.082107:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789683570.090268:0:15814:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0f8b861360 - data ffff9f0fafd41d80/ffff9f0e82fe1c00 00000020:01000000:1.0:1789683570.090411:0:15814:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0e82455c00 - data ffff9f0fafde10d8/ffff9f0e83672800 00100000:10000000:1.0:1789683570.101274:0:15814:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789683570.111758:0:15814:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8894df 00000020:00000080:0.0:1789683570.111772:0:15814:0:(genops.c:885:class_export_put()) final put ffff9f0e82d9e800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789683570.111825:0:15814:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0e827aa000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789683570.111829:0:15814:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0e827aa000 2 00000020:01000004:0.0:1789683570.111832:0:15814:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0e827aa000 from lustre-OST0001 00000020:00000080:0.0:1789683570.111859:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789683570.111868:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789683570.111871:0:15814:0:(genops.c:885:class_export_put()) final put ffff9f0e82d9e000/lustre-OST0001_UUID 00000020:00000080:0.0:1789683570.111873:0:15814:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82d9e000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789683570.111880:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:3.0:1789683570.112509:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82d9e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1789683570.112650:0:15814:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e97b3c51-c653-4f2f-8e95-54cfcf70f127->MGS 00010000:00010000:0.0:1789683570.112665:0:15814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f80030600/0xcf8485587b889238 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b88923f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683570.112679:0:15814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f80030600/0xcf8485587b889238 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b88923f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683570.112686:0:15814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789683570.112688:0:15814:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789683570.112691:0:15814:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789683570.112704:0:15814:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0fa50cb000 00010000:00010000:0.0:1789683570.112709:0:15814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f80030600/0xcf8485587b889238 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b88923f expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683570.112724:0:15814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0e837da600/0xcf8485587b8896bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf8485587b8896c2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683570.112747:0:15814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837da600/0xcf8485587b8896bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf8485587b8896c2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683570.112752:0:15814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789683570.112754:0:15814:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789683570.112756:0:15814:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789683570.112773:0:15814:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0fa50cb000 00010000:00010000:0.0:1789683570.112776:0:15814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0e837da600/0xcf8485587b8896bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf8485587b8896c2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789683570.121149:0:15814:0:(import.c:65:import_set_state_nolock()) ffff9f0fa50cb000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789683570.121167:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789683570.121170:0:15814:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789683570.121171:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789683570.121177:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789683570.121190:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0fc0727b80 x1876618850243584/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789683587 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789683570.121273:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789683570.121277:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:2.0:1789683570.123564:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e97b3c51-c653-4f2f-8e95-54cfcf70f127:3646:1876618850243584:0@lo:250:kworker.0 10000000:01000000:0.0:1789683570.123674:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789683570.123689:0:15814:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889135 00000020:00000080:0.0:1789683570.123699:0:15814:0:(genops.c:885:class_export_put()) final put ffff9f0fa50cd800/e97b3c51-c653-4f2f-8e95-54cfcf70f127 00000020:01000000:0.0:1789683570.123722:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.150@tcp (flags='') 00000020:00000080:0.0:1789683570.123732:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789683570.123739:0:15814:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.150@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789683570.123743:0:15814:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9f0fa508b380) has no exports 00000020:00000080:3.0:1789683570.123819:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fa50cd800/e97b3c51-c653-4f2f-8e95-54cfcf70f127 for MGC192.168.201.150@tcp 10000000:01000000:2.0:1789683570.123931:0:6518:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789683570.124178:0:15814:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.150@tcp: client import never connected 00000100:00080000:3.0:1789683570.124182:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789683570.124185:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789683570.124189:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789683570.124191:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789683570.124246:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789683570.124254:0:15814:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.150@tcp (uuid e97b3c51-c653-4f2f-8e95-54cfcf70f127) 00000020:01000000:3.0:1789683570.124263:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789683570.124266:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683570.124271:0:15814:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789683570.124287:0:15814:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9f0e83441800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789683570.124292:0:15814:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff9f0fb5048000) has exports, disconnecting them 00000020:00080000:3.0:1789683570.124296:0:15814:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9f0e83441800), last request at 1789683345 00000020:00000080:3.0:1789683570.124300:0:15814:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b889509 00000020:00080000:3.0:1789683570.124312:0:15814:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0e83441800): rc 0 00000020:00000080:3.0:1789683570.124316:0:15814:0:(genops.c:885:class_export_put()) final put ffff9f0e83441800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789683570.126687:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0fa50cb000 for MGC192.168.201.150@tcp 00000020:00000080:2.0:1789683570.126706:0:36:0:(genops.c:885:class_export_put()) final put ffff9f0fa50ca800/e97b3c51-c653-4f2f-8e95-54cfcf70f127 00000020:00000080:2.0:1789683570.126709:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fa50ca800/e97b3c51-c653-4f2f-8e95-54cfcf70f127 for MGC192.168.201.150@tcp 00000020:01000000:2.0:1789683570.126724:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.150@tcp (e97b3c51-c653-4f2f-8e95-54cfcf70f127) 00000020:00000080:2.0:1789683570.127101:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83441800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789683570.127131:0:15814:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789683570.127135:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789683570.127140:0:15814:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789683570.127146:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789683570.127309:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683570.127318:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1789683570.127323:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789683570.127327:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789683570.127332:0:15814:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789683570.127338:0:15814:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9f0e82751800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789683570.127587:0:15814:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff9f0fc1244d40) has exports, disconnecting them 00000020:00080000:2.0:1789683570.127594:0:15814:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9f0e82751800), last request at 1789683345 00000020:00000080:2.0:1789683570.127598:0:15814:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88951e 00000020:00080000:2.0:1789683570.127616:0:15814:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0e82751800): rc 0 00000020:00000080:2.0:1789683570.127621:0:15814:0:(genops.c:885:class_export_put()) final put ffff9f0e82751800/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1789683570.128338:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e83442000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789683570.128365:0:36:0:(genops.c:885:class_export_put()) final put ffff9f0e83441000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789683570.128369:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e83441000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789683570.128375:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789683570.128451:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82751800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1789683570.132867:0:15814:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789683570.132877:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789683570.132881:0:15814:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789683570.132888:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789683570.132954:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9f0e82752000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1789683570.134329:0:9528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789683570.136080:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789683570.136214:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1789683570.299196:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1789683570.299441:0:6505:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9f0f848ee800:6505] 1 exiting: rc = 0 00000100:00100000:2.0:1789683570.316849:0:6504:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9f0fa01c8c00:6504] 0 exiting: rc = 1 00000100:00100000:3.0:1789683570.322840:0:13739:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9f0e83563200:13739] 2 exiting: rc = 0 00000100:00100000:0.0:1789683570.322948:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.323272:0:6508:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9f0f8bdd1a00:6508] 2 exiting: rc = 0 00000100:00100000:2.0:1789683570.323634:0:6507:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9f0f857b4c00:6507] 1 exiting: rc = 0 00000100:00100000:1.0:1789683570.323711:0:10343:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9f0e81d46e00:10343] 3 exiting: rc = 0 00000100:00100000:2.0:1789683570.323717:0:6506:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9f0f857b5e00:6506] 0 exiting: rc = 1 00000100:00100000:0.0:1789683570.324424:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.324434:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328522:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328542:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328549:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328556:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328562:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328568:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328574:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328581:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328587:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328593:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328599:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328605:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328611:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328616:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328621:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328627:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328633:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328642:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328662:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328667:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328673:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328679:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328684:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328690:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328695:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328702:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328707:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328712:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328718:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328723:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328729:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328735:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328740:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328746:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328752:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328756:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328761:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328766:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328770:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328775:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328780:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328810:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328817:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328824:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328831:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328840:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328849:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328854:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328859:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328865:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328870:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328875:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328881:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328906:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328911:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328916:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328921:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328925:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328931:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328936:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328942:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.328947:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789683570.330555:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789683570.330567:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1789683570.330573:0:15814:0:(genops.c:885:class_export_put()) final put ffff9f0e82756800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1789683570.330577:0:15814:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e82756800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1789683570.330582:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1789683570.330633:0:15814:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0e827aa000 1 00000020:00000080:0.0:1789683570.330639:0:15814:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b8894ae 00000020:00000080:0.0:1789683570.330646:0:15814:0:(genops.c:885:class_export_put()) final put ffff9f0fc06a6800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789683570.330668:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789683570.330672:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789683570.330676:0:15814:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789683570.330680:0:15814:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff9f0f861819c0) has no exports 00000020:00000080:2.0:1789683570.330907:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fc06a6800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789683570.356288:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683570.356301:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789683570.356306:0:15814:0:(genops.c:885:class_export_put()) final put ffff9f0e827ab000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789683570.356311:0:15814:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0e827ab000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789683570.356317:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789683570.356646:0:15814:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f0e827ae800 00000020:01000000:2.0:1789683570.356665:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789683570.356669:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789683570.356674:0:15814:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789683570.356678:0:15814:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9f0fc12419c0) has no exports 00000020:00000080:2.0:1789683570.356702:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683570.356708:0:15814:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789683570.356710:0:15814:0:(genops.c:885:class_export_put()) final put ffff9f0fb613f800/OSS_uuid 00000020:00000080:2.0:1789683570.356713:0:15814:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0fb613f800/OSS_uuid for OSS 00000020:01000000:2.0:1789683570.356727:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1789683570.356842:0:8676:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9f0fc077a800:8676] 3 exiting: rc = 0 00000100:00100000:0.0:1789683570.356899:0:8440:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9f0fc13e2c00:8440] 2 exiting: rc = 0 00000100:00080000:3.0:1789683570.356970:0:6517:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789683570.357015:0:8437:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9f0f845aca00:8437] 0 exiting: rc = 1 00000100:00100000:3.0:1789683570.357123:0:8439:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9f0fb6050e00:8439] 1 exiting: rc = 0 00000100:00100000:1.0:1789683570.359180:0:14000:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff9f0e83cc5000:14000] 4 exiting: rc = 0 00000100:00100000:2.0:1789683570.359286:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359307:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359319:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359326:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359332:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359337:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359343:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359348:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359354:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359359:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359365:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359371:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359376:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359382:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359387:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359392:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359398:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359403:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359408:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359414:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359419:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359425:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359429:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359434:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359440:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359445:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359450:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359455:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359460:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359465:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359470:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359475:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359480:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359496:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359503:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359510:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359518:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359524:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359529:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359535:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359541:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359546:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359552:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359556:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359562:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359572:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359578:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359583:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359588:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359594:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359599:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359604:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359609:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359613:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359618:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359624:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359629:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359634:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359639:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359644:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359649:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359654:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359660:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.359674:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.360626:0:8442:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9f0fc06c0000:8442] 1 exiting: rc = 0 00000100:00100000:3.0:1789683570.360628:0:8441:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9f0fc06c0c00:8441] 0 exiting: rc = 1 00000100:00100000:2.0:1789683570.360686:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360694:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360702:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360709:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360724:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360729:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360734:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360739:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360744:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360749:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360754:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360759:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360810:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360817:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360822:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360827:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360832:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360838:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360842:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360847:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360852:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360868:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.360878:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361020:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361030:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361036:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361041:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361046:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361052:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361057:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361062:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361067:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361072:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361077:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361083:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361088:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361093:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361098:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361103:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361116:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361121:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361127:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361132:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361138:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361144:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361150:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361156:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361161:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361166:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361171:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361176:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361181:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361186:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361191:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361196:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361201:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361206:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361210:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361215:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361220:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361225:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361230:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361235:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.361241:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.362237:0:8445:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9f0f91fa1c00:8445] 2 exiting: rc = 0 00000100:00100000:0.0:1789683570.363109:0:8443:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9f0fc06d9e00:8443] 0 exiting: rc = 1 00000100:00100000:1.0:1789683570.367359:0:8444:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9f0fc17e9400:8444] 1 exiting: rc = 0 00000100:00100000:2.0:1789683570.367440:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367448:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367461:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367468:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367475:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367481:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367486:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367492:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367499:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367504:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367524:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367543:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367552:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367559:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367568:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367577:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367585:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367591:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367599:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367605:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367612:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367619:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367624:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367629:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367634:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367639:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367644:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367650:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367656:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367661:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367666:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367672:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367676:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367682:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367687:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367704:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367710:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367714:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367719:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367724:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367729:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367734:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367739:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367745:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367750:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367761:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367765:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367770:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367775:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367781:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367804:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367812:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367822:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367830:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367838:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367846:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367853:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367864:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367870:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367876:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367882:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367899:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367914:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683570.367922:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683570.381000:0:8446:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9f0fc17e8400:8446] 0 exiting: rc = 1 00000100:00100000:0.0:1789683570.381004:0:8447:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9f0fc17e8800:8447] 1 exiting: rc = 0 00000100:00100000:3.0:1789683570.381485:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381493:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381498:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381504:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381509:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381515:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381520:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381526:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381532:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381537:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381541:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381547:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381553:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381559:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381565:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381570:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381575:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381580:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381586:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381591:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381597:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381614:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381619:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381624:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381630:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381634:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381639:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381644:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381662:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381668:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381673:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381679:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381684:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381689:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381695:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381700:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381705:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381710:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.381720:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382228:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382235:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382241:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382245:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382250:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382256:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382261:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382265:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382270:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382276:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382280:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382285:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382290:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382295:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382300:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382305:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382310:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382323:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382328:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382333:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.382337:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.383517:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.383524:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.383528:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.383534:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683570.392648:0:8449:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9f0fc17e7800:8449] 1 exiting: rc = 0 00000100:00100000:1.0:1789683570.392769:0:8448:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9f0fc17e9200:8448] 0 exiting: rc = 1 00000100:00100000:3.0:1789683570.392858:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.392878:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.392914:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.392922:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.392928:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.392934:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.392940:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.392945:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.392950:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.392955:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.392961:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.392967:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.392972:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.392978:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.392998:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393006:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393013:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393019:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393025:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393032:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393039:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393048:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393056:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393063:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393069:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393076:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393097:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393117:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393125:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393136:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393147:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393161:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393170:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393177:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393183:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393188:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393193:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393201:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393222:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393228:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393234:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393239:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393245:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393251:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393257:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393263:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393268:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393274:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393279:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393287:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393307:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393313:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393319:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393324:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393330:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393336:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393466:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393473:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393478:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393483:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393488:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393493:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393506:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683570.393520:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789683570.402180:0:15814:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789683592.148455:0:16579:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789683603.836180:0:17179:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789683603.836187:0:17179:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789683603.836189:0:17179:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789683603.836321:0:17179:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0e83ec0800 00000020:01000004:0.0:1789683603.836346:0:17179:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789683603.836354:0:17179:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789683603.836369:0:17179:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9f0e8240b380) 00000020:00000080:0.0:1789683603.836383:0:17179:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789683603.909951:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789683603.922044:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789683603.925898:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1789683603.926610:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789683603.927861:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1789683603.928861:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1789683603.931871:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789683603.937513:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789683603.938244:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1789683603.938614:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789683603.939119:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1789683603.939403:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789683603.939642:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789683603.940009:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1789683603.948344:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1789683603.950395:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789683603.950866:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1789683603.951477:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789683603.951681:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1789683603.952878:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1789683603.953390:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789683603.953595:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1789683603.954318:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789683603.954867:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1789683603.955645:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789683603.956384:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1789683603.957015:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1789683603.959105:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789683603.963625:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789683603.970233:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789683603.971284:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1789683603.971924:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789683603.972440:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789683603.972737:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789683603.973113:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789683603.973504:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789683603.973707:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789683603.974523:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789683603.974878:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789683603.975983:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789683603.976652:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789683603.977521:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789683603.981433:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789683603.982061:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789683603.982472:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789683603.982861:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789683603.983102:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789683603.985018:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789683603.986515:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789683603.987259:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789683603.989927:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1789683603.990628:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1789683603.991023:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:2.0:1789683603.993835:0:17179:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789683603.994088:0:17179:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789683603.994097:0:17179:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789683603.994109:0:17179:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b88a6e4 00000020:01000004:2.0:1789683603.994118:0:17179:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789683603.994124:0:17179:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789683603.994140:0:17179:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0e83ec0800 from MGS 00000020:01000004:2.0:1789683603.994144:0:17179:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789683603.994156:0:17179:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9f0fb5048000) 00000020:00000080:2.0:1789683603.994167:0:17179:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789683603.994907:0:17179:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0e83ec0800 from MGS, refs=2 00080000:01000000:2.0:1789683603.994915:0:17179:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789683603.994923:0:17179:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b88a6f2 00000100:00100000:2.0:1789683603.995046:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789683603.995175:0:17179:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789683603.995181:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789683603.996477:0:17179:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789683603.996486:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789683603.998955:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683603.999469:0:17179:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789683603.999486:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789683604.000565:0:17179:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789683604.000575:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789683604.001317:0:17179:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789683604.001324:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789683604.002051:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683604.002055:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683604.002056:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683604.002565:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683604.002567:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683604.002569:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683604.007919:0:17179:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789683604.013575:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789683604.023663:0:17179:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789683604.026805:0:17191:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789683604.026852:0:17179:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789683604.026914:0:17179:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789683604.028069:0:17179:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789683604.028506:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789683604.028681:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789683604.028688:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789683604.033653:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789683604.033669:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789683604.034393:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789683604.034402:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789683604.035177:0:17179:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789683604.035198:0:17179:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.150@tcp' 00000100:00080000:3.0:1789683604.035380:0:17196:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:2.0:1789683604.035402:0:17179:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789683604.035441:0:17179:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.150@tcp (typ=mgc) 00000020:00000080:2.0:1789683604.035454:0:17179:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.150@tcp (ffff9f0fb504b380) 00000020:00000080:2.0:1789683604.035470:0:17179:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789683604.035547:0:17179:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0fb7aa0800@MGC192.168.201.150@tcp: add connection 192.168.201.150@tcp at head 00010000:00010000:2.0:1789683604.035696:0:17179:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.150@tcp-0 is initialized 00000040:01000000:2.0:1789683604.035702:0:17179:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 1 is initialized 10000000:01000000:2.0:1789683604.039974:0:17197:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789683604.040058:0:17179:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.150@tcp (uuid 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7) 00000020:00000080:3.0:1789683604.040079:0:17179:0:(genops.c:1384:class_connect()) connect: client 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7, cookie 0xcf8485587b88a700 00000100:00080000:3.0:1789683604.040092:0:17179:0:(import.c:545:import_select_connection()) MGC192.168.201.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683604.040105:0:17179:0:(import.c:666:import_select_connection()) MGC192.168.201.150@tcp: import ffff9f0fb7aa0800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683604.040153:0:17179:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc0724700 x1876618850243712/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683604.040180:0:17179:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7->MGS 00000020:01000004:3.0:1789683604.040197:0:17179:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789683604.040217:0:17179:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789683604.040230:0:17179:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9f0e837a99c0) 00000020:00000080:3.0:1789683604.040242:0:17179:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789683604.040417:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3646:1876618850243712:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789683604.040487:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683604.043920:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850243712 00000100:00100000:2.0:1789683604.043937:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850243712 00000100:00100000:2.0:1789683604.043995:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683604.044004:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1876618850243712:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789683604.044036:0:17193:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:2.0:1789683604.044068:0:17193:0:(genops.c:1384:class_connect()) connect: client 4e5e0833-60b8-4f67-ab09-c7aa3b4baab7, cookie 0xcf8485587b88a70e 00000100:00080000:2.0:1789683604.044589:0:17193:0:(import.c:65:import_set_state_nolock()) ffff9f0fb7aa1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789683604.044691:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+5:3646:x1876618850243712:12345-0@lo:250:mount.lustre.0 Request processed in 686us (4202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683604.044699:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683604.044989:0:3646:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789683604.045001:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.150@tcp: connect to target with instance 0 00000100:00080000:0.0:1789683604.045009:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789683604.045014:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789683604.045018:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb7aa0800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789683604.045020:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789683604.045034:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789683604.045040:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3646:1876618850243712:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789683604.061910:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683604.062135:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789683604.062143:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789683604.066894:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789683604.066907:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789683604.069119:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789683604.069130:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789683604.070492:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683604.070682:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789683604.070695:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789683604.073543:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789683604.073629:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789683604.125984:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789683604.126203:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789683604.126210:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789683604.130429:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789683604.130450:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789683604.131374:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683604.131545:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789683604.131550:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789683604.132494:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789683604.132503:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789683604.133086:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683604.133244:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789683604.133248:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789683604.133916:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789683604.133925:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789683604.134753:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789683604.135118:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789683604.135123:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789683604.135751:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789683604.135760:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789683604.153634:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789683604.153985:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789683604.153993:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789683604.155725:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789683604.155737:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789683604.161417:0:17179:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789683604.161435:0:17179:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789683604.163093:0:17179:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789683604.163136:0:17179:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789683604.163142:0:17179:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789683604.163247:0:17179:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789683604.163281:0:17179:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.150@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789683604.163296:0:17179:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789683604.163297:0:17179:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789683604.163299:0:17179:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683604.163300:0:17179:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683604.163301:0:17179:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683604.163302:0:17179:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683604.163304:0:17179:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789683604.163305:0:17179:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789683604.163307:0:17179:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683604.163308:0:17179:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789683604.163319:0:17179:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789683604.163322:0:17179:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789683604.163323:0:17179:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789683604.163324:0:17179:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683604.163325:0:17179:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683604.163326:0:17179:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683604.163327:0:17179:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683604.163328:0:17179:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789683604.163329:0:17179:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789683604.163330:0:17179:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683604.163331:0:17179:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789683604.163358:0:17179:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789683604.163378:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850243840:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789683604.163448:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683604.163507:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e810bf780 going to sleep for 11 seconds 00000100:00100000:0.0:1789683604.163652:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850243840 00000100:00100000:0.0:1789683604.163659:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850243840 00000100:00100000:0.0:1789683604.163704:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683604.163714:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+5:17179:x1876618850243840:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789683604.163763:0:17195:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789683604.163767:0:17195:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789683604.163771:0:17195:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1789683604.166078:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789683604.166542:0:17195:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1789683604.170129:0:17217:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789683604.170139:0:17217:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1789683604.170142:0:17217:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789683604.170145:0:17217:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789683604.170412:0:17217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1789683604.170638:0:17195:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789683604.170651:0:17195:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789683604.173144:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+5:17179:x1876618850243840:12345-0@lo:253:mount.lustre.0 Request processed in 9422us (9686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683604.173158:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683604.173320:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850243840:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789683604.173349:0:17179:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789683604.173352:0:17179:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789683604.173354:0:17179:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789683604.173355:0:17179:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683604.173356:0:17179:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683604.173357:0:17179:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683604.173359:0:17179:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683604.173360:0:17179:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789683604.173361:0:17179:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789683604.173363:0:17179:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683604.173364:0:17179:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789683604.173389:0:17179:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0e83ec0800 from lustre-MDT0000 10000000:01000000:3.0:1789683604.173427:0:17179:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789683604.173430:0:17179:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789683604.173436:0:17179:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9f0fb504b380 10000000:01000000:3.0:1789683604.173511:0:17179:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789683604.173522:0:17179:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f0fb504b380 from 1 10000000:01000000:3.0:1789683604.173525:0:17179:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789683604.173564:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.173705:0:17179:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.173715:0:17179:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683604.173970:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850243968:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789683604.174011:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683604.174095:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e810bf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683604.174144:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850243968 00000100:00100000:2.0:1789683604.174151:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850243968 00000100:00100000:2.0:1789683604.174223:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789683604.174308:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+5:17179:x1876618850243968:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683604.174323:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683604.174338:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f9e00/0xcf8485587b88a71c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a715 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683604.174361:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f9e00/0xcf8485587b88a71c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a715 expref: 6 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683604.174372:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f9e00/0xcf8485587b88a71c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a715 expref: 6 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683604.174381:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f9e00, rc 0) 00000100:00100000:2.0:1789683604.174423:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+6:17179:x1876618850243968:12345-0@lo:101:mount.lustre.0 Request processed in 193us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683604.174430:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683604.174585:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850243968:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683604.174608:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a71c expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.174628:0:17179:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a71c expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683604.174691:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850244096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683604.174716:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683604.175191:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e810bf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683604.175255:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850244096 00000100:00100000:1.0:1789683604.175261:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850244096 00000100:00100000:1.0:1789683604.175297:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683604.175304:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+6:17179:x1876618850244096:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683604.175394:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+6:17179:x1876618850244096:12345-0@lo:501:mount.lustre.0 Request processed in 90us (676us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789683604.175401:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789683604.175603:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850244096:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789683604.175631:0:17179:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789683604.175655:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a71c expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.175664:0:17179:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a71c expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683604.175673:0:17179:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0e83ec0800 10000000:01000000:3.0:1789683604.175677:0:17179:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789683604.175681:0:17179:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f0e83ec0800 10000000:01000000:3.0:1789683604.175683:0:17179:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789683604.175686:0:17179:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f0e83ec0800 from 1 10000000:01000000:3.0:1789683604.175688:0:17179:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789683604.175710:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177e00/0xcf8485587b88a723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.175717:0:17179:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177e00/0xcf8485587b88a723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.176219:0:17179:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177e00/0xcf8485587b88a723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683604.176255:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850244224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789683604.176297:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683604.176327:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e810bf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683604.176377:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850244224 00000100:00100000:1.0:1789683604.176382:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850244224 00000100:00100000:1.0:1789683604.176404:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789683604.176410:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+6:17179:x1876618850244224:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683604.176419:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683604.176431:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837dbe00/0xcf8485587b88a72a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a723 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683604.176469:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837dbe00/0xcf8485587b88a72a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a723 expref: 7 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683604.176477:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837dbe00/0xcf8485587b88a72a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a723 expref: 7 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683604.176485:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dbe00, rc 0) 00000100:00100000:1.0:1789683604.176522:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+7:17179:x1876618850244224:12345-0@lo:101:mount.lustre.0 Request processed in 111us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683604.176527:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789683604.176949:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850244224:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683604.176962:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177e00/0xcf8485587b88a723 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a72a expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.176971:0:17179:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177e00/0xcf8485587b88a723 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a72a expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683604.176984:0:17179:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789683604.177001:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177e00/0xcf8485587b88a723 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a72a expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.177008:0:17179:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177e00/0xcf8485587b88a723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a72a expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683604.177015:0:17179:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789683604.177019:0:17179:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789683604.177025:0:17179:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f0e83ec0800 10000000:01000000:3.0:1789683604.177027:0:17179:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789683604.177031:0:17179:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789683604.177033:0:17179:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789683604.177052:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176c00/0xcf8485587b88a731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.177060:0:17179:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176c00/0xcf8485587b88a731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.177075:0:17179:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176c00/0xcf8485587b88a731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683604.177089:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850244352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789683604.177120:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683604.177151:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850244352 00000100:00100000:3.0:1789683604.177155:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850244352 00000100:00100000:3.0:1789683604.177177:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683604.177183:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+7:17179:x1876618850244352:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683604.177190:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683604.177199:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb6176400/0xcf8485587b88a738 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a731 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.177213:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb6176400/0xcf8485587b88a738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a731 expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.177221:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb6176400/0xcf8485587b88a738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a731 expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.177227:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176400, rc 0) 00000100:00100000:3.0:1789683604.177250:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+8:17179:x1876618850244352:12345-0@lo:101:mount.lustre.0 Request processed in 68us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683604.177256:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683604.177300:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e810bf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683604.177313:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850244352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683604.177323:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176c00/0xcf8485587b88a731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a738 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.177338:0:17179:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176c00/0xcf8485587b88a731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a738 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683604.177391:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850244480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683604.177414:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683604.177435:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850244480 00000100:00100000:3.0:1789683604.177452:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850244480 00000100:00100000:3.0:1789683604.177470:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683604.177476:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+8:17179:x1876618850244480:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683604.178008:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+9:17179:x1876618850244480:12345-0@lo:501:mount.lustre.0 Request processed in 530us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683604.178016:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683604.178044:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e810bf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683604.178056:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850244480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683604.178082:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850244608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789683604.178117:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683604.178143:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e810bf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683604.178192:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850244608 00000100:00100000:1.0:1789683604.178196:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850244608 00000100:00100000:1.0:1789683604.178215:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789683604.178219:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+9:17179:x1876618850244608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683604.179131:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+9:17179:x1876618850244608:12345-0@lo:503:mount.lustre.0 Request processed in 905us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683604.179142:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789683604.179646:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850244608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789683604.180430:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17218:1876618850244736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683604.180498:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683604.180536:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e810bf480 going to sleep for 11 seconds 00000100:00100000:1.0:1789683604.180758:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850244736 00000100:00100000:1.0:1789683604.180764:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850244736 00000100:00100000:1.0:1789683604.180824:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789683604.180834:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+9:17218:x1876618850244736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683604.181679:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+9:17218:x1876618850244736:12345-0@lo:502:llog_process_th.0 Request processed in 843us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683604.181688:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789683604.182170:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17218:1876618850244736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789683604.182207:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683604.182224:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683604.182226:0:17218:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789683604.182245:0:17218:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789683604.182248:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789683604.182263:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9f0e837a8000) 00000020:00000080:3.0:1789683604.182290:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789683604.182296:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789683604.182385:0:17218:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789683604.182393:0:17218:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b88a746 00000020:00000080:3.0:1789683604.183010:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789683604.183015:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683604.183020:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683604.183022:0:17218:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789683604.183025:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683604.183029:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683604.183031:0:17218:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789683604.183034:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789683604.183043:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9f0e837acd40) 00000020:00000080:3.0:1789683604.183055:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789683604.183059:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789683604.183061:0:17218:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789683604.183064:0:17218:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789683604.183071:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789683604.183118:0:17218:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0e83ec0800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789683604.183130:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9f0e837ab380) 00000020:00000080:3.0:1789683604.183137:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789683604.183206:0:17218:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789683604.183212:0:17218:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b88a75b 00000020:00000080:3.0:1789683604.183378:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789683604.183385:0:17218:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789683604.183390:0:17218:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcf8485587b88a762 00080000:01000000:3.0:1789683604.183395:0:17218:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789683604.183399:0:17218:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b88a769 00010000:00010000:3.0:1789683604.287411:0:17218:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789683604.288998:0:17218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1789683604.289385:0:17218:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789683604.290408:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9f0fa508b380) 00000020:00000080:3.0:1789683604.290430:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789683604.290540:0:17218:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789683604.290548:0:17218:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b88a777 00000020:00000080:0.0:1789683604.295983:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789683604.309101:0:17218:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcf8485587b88a77e 00000020:00000080:1.0:1789683604.310082:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789683604.310102:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683604.310108:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683604.310111:0:17218:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789683604.310115:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789683604.310118:0:17218:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1789683604.310119:0:17218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683604.310121:0:17218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683604.310123:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789683604.310125:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683604.310126:0:17218:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789683604.310129:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683604.310134:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683604.310135:0:17218:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789683604.310140:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789683604.310183:0:17218:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789683604.310209:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683604.310213:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683604.310215:0:17218:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789683604.310225:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683604.310299:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683604.310302:0:17218:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789683604.310307:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789683604.310313:0:17218:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:00000080:1.0:1789683604.310341:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789683604.310357:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9f0e83c2cd40) 00000020:00000080:1.0:1789683604.310376:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789683604.310381:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789683604.310436:0:17218:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789683604.310693:0:17218:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789683604.310700:0:17218:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b88a78c 00010000:00080000:1.0:1789683604.310882:0:17218:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0e83d4f000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00010000:1.0:1789683604.324261:0:17218:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1789683604.328002:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789683604.328022:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789683604.328057:0:17218:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789683604.328078:0:17218:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b88a793 00000100:00080000:1.0:1789683604.328088:0:17218:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789683604.328100:0:17218:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0e83d4f000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683604.328140:0:17218:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb7999880 x1876618850244864/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789683604.328226:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850244864:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789683604.328310:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789683604.328925:0:17218:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1789683604.328987:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683604.328992:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683604.328994:0:17218:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789683604.328997:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789683604.329000:0:17218:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1789683604.329001:0:17218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683604.329003:0:17218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683604.329004:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789683604.329006:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683604.329008:0:17218:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789683604.329011:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789683604.329015:0:17218:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789683604.329018:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683604.329020:0:17218:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789683604.329022:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789683604.329026:0:17218:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:1.0:1789683604.329047:0:17218:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789683604.329050:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789683604.329063:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9f0e83c2b380) 00000020:00000080:1.0:1789683604.329076:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789683604.329081:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789683604.329156:0:17218:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789683604.329162:0:17218:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789683604.329174:0:17218:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b88a7a1 00000100:00100000:3.0:1789683604.329483:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850244864 00000100:00100000:3.0:1789683604.329491:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850244864 00000100:00100000:3.0:1789683604.329524:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789683604.329532:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1876618850244864:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1789683604.329548:0:17205:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1789683604.331886:0:17218:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0e83446000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00010000:1.0:1789683604.332137:0:17218:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789683604.335716:0:17218:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789683604.336405:0:17218:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789683604.350402:0:17218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683604.350934:0:17218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00100000:3.0:1789683604.385267:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1876618850244864:12345-0@lo:38:llog_process_th.0 Request processed in 55726us (56948us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789683604.385293:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789683604.388593:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d4f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683604.388606:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789683604.388612:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850244864:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789683604.389234:0:17218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789683604.391545:0:17224:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789683604.391552:0:17224:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789683604.398039:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789683604.398057:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789683604.398106:0:17218:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789683604.398127:0:17218:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b88a7a8 00000100:00080000:2.0:1789683604.398138:0:17218:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789683604.398150:0:17218:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f0e83446000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683604.398195:0:17218:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7247480 x1876618850244992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789683604.398221:0:17218:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789683604.398293:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683604.398298:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683604.398300:0:17218:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789683604.398303:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789683604.398305:0:17218:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1789683604.398307:0:17218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789683604.398309:0:17218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789683604.398310:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789683604.398313:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683604.398314:0:17218:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789683604.398317:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789683604.398320:0:17218:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789683604.398324:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683604.398325:0:17218:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789683604.398328:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789683604.398332:0:17218:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:2.0:1789683604.398354:0:17218:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789683604.398356:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789683604.398367:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9f0fb50499c0) 00000020:00000080:2.0:1789683604.398379:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1789683604.398384:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789683604.398453:0:17218:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789683604.398460:0:17218:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789683604.398466:0:17218:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf8485587b88a7b6 00010000:00080000:2.0:1789683604.398493:0:17218:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0fb240d000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.150@tcp at head 00000100:00100000:3.0:1789683604.398753:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850244992:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789683604.398824:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850244992 offset 0 length 520: 4 00010000:00010000:2.0:1789683604.400225:0:17218:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789683604.400318:0:17218:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789683604.400334:0:17218:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789683604.404136:0:17218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789683604.404326:0:17218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789683604.404641:0:17218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789683604.405171:0:17226:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789683604.405177:0:17226:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789683604.406100:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789683604.406113:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789683604.406151:0:17218:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789683604.406172:0:17218:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b88a7bd 00000100:00080000:2.0:1789683604.406184:0:17218:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789683604.406196:0:17218:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0fb240d000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683604.406233:0:17218:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7245c00 x1876618850245120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789683604.406303:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850245120:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789683604.406372:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850245120 offset 0 length 520: 4 00000100:00080000:2.0:1789683604.406429:0:17218:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789683604.406495:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683604.406499:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683604.406501:0:17218:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789683604.406504:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683604.406507:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683604.406508:0:17218:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789683604.406511:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789683604.406513:0:17218:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789683604.406515:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683604.406517:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683604.406519:0:17218:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789683604.406521:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683604.406523:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683604.406524:0:17218:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789683604.406527:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789683604.406556:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17218:1876618850245248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683604.406616:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683604.406639:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c22a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683604.406661:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850245248 00000100:00100000:2.0:1789683604.406672:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850245248 00000100:00100000:2.0:1789683604.406716:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789683604.406724:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+9:17218:x1876618850245248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683604.406869:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+9:17218:x1876618850245248:12345-0@lo:502:llog_process_th.0 Request processed in 144us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683604.406877:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789683604.406931:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17218:1876618850245248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789683604.406954:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683604.406958:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683604.406959:0:17218:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789683604.406962:0:17218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789683604.407075:0:17179:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1789683604.407101:0:17179:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789683604.407116:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176c00/0xcf8485587b88a731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a738 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683604.407128:0:17179:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176c00/0xcf8485587b88a731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a738 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683604.407136:0:17179:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0e83ec0800 from 1 10000000:01000000:2.0:1789683604.407139:0:17179:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789683604.407163:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a7c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683604.407171:0:17179:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a7c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683604.407182:0:17179:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a7c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683604.407205:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850245376:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789683604.407233:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683604.407246:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c22a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683604.407866:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850245376 00000100:00100000:1.0:1789683604.407874:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850245376 00000100:00100000:1.0:1789683604.407909:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789683604.407916:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+9:17179:x1876618850245376:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683604.407928:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683604.407943:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837dae00/0xcf8485587b88a7cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a7c4 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683604.407968:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837dae00/0xcf8485587b88a7cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a7c4 expref: 10 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683604.407980:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837dae00/0xcf8485587b88a7cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a7c4 expref: 10 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683604.407989:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dae00, rc 0) 00000100:00100000:1.0:1789683604.408035:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+10:17179:x1876618850245376:12345-0@lo:101:mount.lustre.0 Request processed in 119us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683604.408041:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789683604.409316:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850245376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683604.409344:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a7c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a7cb expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683604.409357:0:17179:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a7c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a7cb expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683604.410148:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850245504:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789683604.410230:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683604.410348:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c22a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683604.412023:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850245504 00000100:00100000:0.0:1789683604.412037:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850245504 00000100:00100000:0.0:1789683604.412133:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789683604.412145:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+10:17179:x1876618850245504:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789683604.412187:0:17193:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789683604.412195:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789683604.412324:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+10:17179:x1876618850245504:12345-0@lo:256:mount.lustre.0 Request processed in 181us (2093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683604.412331:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789683604.412415:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850245504:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789683604.413037:0:17179:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789683604.413059:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a7c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a7cb expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683604.413072:0:17179:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a7c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a7cb expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683604.413081:0:17179:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0e83ec0800 from 1 10000000:01000000:2.0:1789683604.413084:0:17179:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683604.413129:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b88a7d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683604.413198:0:17179:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b88a7d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683604.413208:0:17179:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b88a7d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683604.413234:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850245632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789683604.413290:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683604.415089:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c22a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683604.416341:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850245632 00000100:00100000:1.0:1789683604.416356:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850245632 00000100:00100000:1.0:1789683604.416417:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789683604.416456:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+10:17179:x1876618850245632:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683604.416475:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683604.416496:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837da600/0xcf8485587b88a7d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a7d2 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683604.416522:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837da600/0xcf8485587b88a7d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a7d2 expref: 11 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683604.416534:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837da600/0xcf8485587b88a7d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a7d2 expref: 11 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683604.416543:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da600, rc 0) 00000100:00100000:1.0:1789683604.416637:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+11:17179:x1876618850245632:12345-0@lo:101:mount.lustre.0 Request processed in 185us (3358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683604.416644:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789683604.416760:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850245632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683604.416779:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b88a7d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a7d9 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683604.416813:0:17179:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b88a7d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a7d9 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683604.416889:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850245760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683604.416924:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683604.416949:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c22a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683604.418092:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850245760 00000100:00100000:1.0:1789683604.418101:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850245760 00000100:00100000:1.0:1789683604.418141:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789683604.418149:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+11:17179:x1876618850245760:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683604.418333:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+11:17179:x1876618850245760:12345-0@lo:501:mount.lustre.0 Request processed in 185us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683604.418341:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789683604.418439:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850245760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683604.418497:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850245888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789683604.418554:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683604.418595:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c22a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683604.419412:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850245888 00000100:00100000:1.0:1789683604.419419:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850245888 00000100:00100000:1.0:1789683604.419460:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789683604.419468:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7958450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+11:17179:x1876618850245888:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683604.419591:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7958450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+11:17179:x1876618850245888:12345-0@lo:503:mount.lustre.0 Request processed in 124us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683604.419607:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789683604.419761:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850245888:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683604.421657:0:17228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17228:1876618850246016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683604.421724:0:17228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683604.421994:0:17228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683604.422057:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850246016 00000100:00100000:0.0:1789683604.422064:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850246016 00000100:00100000:0.0:1789683604.422102:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789683604.422111:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7959850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+11:17228:x1876618850246016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683604.422724:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7959850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+11:17228:x1876618850246016:12345-0@lo:502:llog_process_th.0 Request processed in 611us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683604.422733:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789683604.423103:0:17228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17228:1876618850246016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789683604.423134:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683604.423145:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683604.423148:0:17228:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789683604.423154:0:17228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0e83ec0800 00000020:00000080:1.0:1789683604.423156:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789683604.423164:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683604.423166:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683604.423168:0:17228:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789683604.423170:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683604.423172:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683604.423174:0:17228:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789683604.423177:0:17228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0e83ec0800 00000020:00000080:1.0:1789683604.423179:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789683604.423244:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683604.423248:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683604.423249:0:17228:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789683604.423252:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683604.423255:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683604.423256:0:17228:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789683604.423259:0:17228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0e83ec0800 00000020:00000080:1.0:1789683604.423261:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789683604.423289:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683604.423292:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683604.423294:0:17228:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789683604.423296:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683604.423306:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683604.423307:0:17228:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789683604.423311:0:17228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0e83ec0800 00000020:00000080:1.0:1789683604.423313:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789683604.423359:0:17228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17228:1876618850246144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683604.423403:0:17228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683604.423521:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850246144 00000100:00100000:3.0:1789683604.423528:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850246144 00000100:00100000:3.0:1789683604.423574:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789683604.423582:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7959450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+11:17228:x1876618850246144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683604.423668:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7959450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+11:17228:x1876618850246144:12345-0@lo:502:llog_process_th.0 Request processed in 86us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683604.423676:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789683604.424170:0:17228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683604.424187:0:17228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17228:1876618850246144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789683604.424209:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683604.424215:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683604.424217:0:17228:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789683604.424220:0:17228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789683604.425204:0:17179:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789683604.425238:0:17179:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789683604.425263:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b88a7d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a7d9 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.425276:0:17179:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b88a7d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a7d9 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683604.425355:0:17179:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789683604.425358:0:17179:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0e83ec0800 10000000:01000000:3.0:1789683604.425361:0:17179:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0e83ec0800 10000000:01000000:3.0:1789683604.425365:0:17179:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789683604.425371:0:17179:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0e83ec0800 from 1 10000000:01000000:3.0:1789683604.425373:0:17179:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789683604.425403:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177800/0xcf8485587b88a7e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.425412:0:17179:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177800/0xcf8485587b88a7e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.425421:0:17179:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177800/0xcf8485587b88a7e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683604.425451:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850246272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789683604.425507:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683604.425538:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e810bf780 going to sleep for 11 seconds 00000100:00100000:3.0:1789683604.425558:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850246272 00000100:00100000:3.0:1789683604.425575:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850246272 00000100:00100000:3.0:1789683604.425606:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789683604.425613:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7958c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+11:17179:x1876618850246272:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683604.425625:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683604.425642:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb6177a00/0xcf8485587b88a7e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a7e0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.425664:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb6177a00/0xcf8485587b88a7e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a7e0 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.425674:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb6177a00/0xcf8485587b88a7e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a7e0 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.425682:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6177a00, rc 0) 00000100:00100000:3.0:1789683604.425716:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7958c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17179:x1876618850246272:12345-0@lo:101:mount.lustre.0 Request processed in 103us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683604.425723:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789683604.425920:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850246272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683604.425934:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177800/0xcf8485587b88a7e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a7e7 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.425943:0:17179:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177800/0xcf8485587b88a7e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a7e7 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683604.426002:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850246400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683604.426026:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683604.426040:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e810bf780 going to sleep for 11 seconds 00000100:00100000:3.0:1789683604.426054:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850246400 00000100:00100000:3.0:1789683604.426058:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850246400 00000100:00100000:3.0:1789683604.426074:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683604.426079:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17179:x1876618850246400:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683604.426191:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17179:x1876618850246400:12345-0@lo:501:mount.lustre.0 Request processed in 111us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683604.426205:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683604.426237:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850246400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683604.426264:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850246528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789683604.426314:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683604.426327:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e810bf780 going to sleep for 11 seconds 00000100:00100000:3.0:1789683604.426340:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850246528 00000100:00100000:3.0:1789683604.426343:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850246528 00000100:00100000:3.0:1789683604.426360:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789683604.426365:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17179:x1876618850246528:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789683604.426438:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17179:x1876618850246528:12345-0@lo:503:mount.lustre.0 Request processed in 72us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683604.426445:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789683604.426482:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850246528:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789683604.433141:0:17231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17231:1876618850246656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683604.433242:0:17231:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683604.433295:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850246656 00000100:00100000:2.0:1789683604.433303:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850246656 00000100:00100000:2.0:1789683604.433354:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789683604.433364:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7959050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17231:x1876618850246656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683604.433490:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7959050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17231:x1876618850246656:12345-0@lo:502:llog_process_th.0 Request processed in 127us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683604.433499:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789683604.433552:0:17231:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c22acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683604.433573:0:17231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17231:1876618850246656:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789683604.433636:0:17231:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789683604.433653:0:17231:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9f0fb504cd40) 00000020:00000080:2.0:1789683604.433689:0:17231:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1789683604.433815:0:17231:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0e83ec0800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789683604.433820:0:17231:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0e83ec0800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789683604.433822:0:17231:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0e83ec0800 4 00010000:00080000:2.0:1789683604.433849:0:17231:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0f8bdb8000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00010000:2.0:1789683604.435420:0:17231:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1789683604.435615:0:17231:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789683604.435654:0:17231:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789683604.435667:0:17231:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcf8485587b88a7f5 00000100:00080000:2.0:1789683604.435677:0:17231:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789683604.435688:0:17231:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f0f8bdb8000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683604.435723:0:17231:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7245180 x1876618850246784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789683604.435772:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876618850246784:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789683604.435868:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683604.435937:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850246784 00000100:00100000:2.0:1789683604.435945:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850246784 00000100:00100000:2.0:1789683604.435977:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683604.435984:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876618850246784:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789683604.436039:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876618850246784:12345-0@lo:38:llog_process_th.0 Request processed in 54us (170us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789683604.436046:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683604.436083:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789683604.436091:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdb8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683604.436117:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789683604.436121:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876618850246784:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789683604.436140:0:17231:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789683604.446975:0:17231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17231:1876618850246912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683604.447067:0:17231:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683604.447111:0:17231:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c22a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683604.447141:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850246912 00000100:00100000:2.0:1789683604.447149:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850246912 00000100:00100000:2.0:1789683604.447197:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789683604.447206:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17231:x1876618850246912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683604.447336:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17231:x1876618850246912:12345-0@lo:502:llog_process_th.0 Request processed in 130us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683604.447343:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789683604.447398:0:17231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17231:1876618850246912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683604.448693:0:17231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17231:1876618850247040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683604.448764:0:17231:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683604.448821:0:17231:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c22a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683604.448846:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850247040 00000100:00100000:2.0:1789683604.448852:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850247040 00000100:00100000:2.0:1789683604.448886:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789683604.448893:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7958850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17231:x1876618850247040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683604.448995:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7958850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17231:x1876618850247040:12345-0@lo:502:llog_process_th.0 Request processed in 101us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683604.449002:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789683604.449052:0:17231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17231:1876618850247040:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789683604.449081:0:17231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789683604.449217:0:17179:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789683604.449244:0:17179:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789683604.449259:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177800/0xcf8485587b88a7e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a7e7 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683604.449271:0:17179:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177800/0xcf8485587b88a7e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a7e7 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789683604.449334:0:17179:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789683604.449337:0:17179:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789683604.449338:0:17179:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683604.449339:0:17179:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683604.449340:0:17179:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683604.449342:0:17179:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683604.449343:0:17179:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789683604.449345:0:17179:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789683604.449347:0:17179:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683604.449349:0:17179:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789683604.449353:0:17179:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789683604.449359:0:17179:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789683604.449360:0:17179:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789683604.449361:0:17179:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683604.449362:0:17179:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683604.449363:0:17179:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683604.449364:0:17179:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683604.449365:0:17179:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789683604.449366:0:17179:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789683604.449366:0:17179:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683604.449367:0:17179:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789683604.449383:0:17179:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789683604.449392:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850247168:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789683604.449420:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683604.449435:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c22a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683604.449457:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850247168 00000100:00100000:2.0:1789683604.449461:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850247168 00000100:00100000:2.0:1789683604.449482:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789683604.449488:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17179:x1876618850247168:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789683604.449509:0:17194:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789683604.449523:0:17194:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789683604.466180:0:17194:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789683604.466209:0:17194:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789683604.466496:0:17216:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789683604.466502:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789683604.466528:0:17216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0e837da400/0xcf8485587b88a7fc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683604.466548:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0e837dae00/0xcf8485587b88a7cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a7c4 expref: 12 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683604.466558:0:17216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0e837da400/0xcf8485587b88a7fc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683604.471407:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0e837dae00/0xcf8485587b88a7cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88a7c4 expref: 12 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683604.471426:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0e837dae00/0xcf8485587b88a7cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88a7c4 expref: 12 pid: 17195 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683604.471444:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1876618850247296:0@lo:104: 00000100:00100000:1.0:1789683604.471531:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683604.471581:0:17216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f87fa3840 going to sleep for 11 seconds 00000100:00100000:0.0:1789683604.472462:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850247296 00000100:00100000:0.0:1789683604.472474:0:17183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850247296 00000100:00100000:0.0:1789683604.472530:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683604.472542:0:17183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+3:17216:x1876618850247296:12345-0@lo:104: 00010000:00010000:0.0:1789683604.472563:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a7c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a7cb expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683604.472648:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789683604.472656:0:17183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+3:17216:x1876618850247296:12345-0@lo:104: Request processed in 116us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683604.472662:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683604.472738:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17179:x1876618850247168:12345-0@lo:253:mount.lustre.0 Request processed in 23249us (23316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683604.472757:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789683604.474519:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1876618850247296:0@lo:104: 00010000:00010000:0.0:1789683604.474547:0:17216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0e837da400/0xcf8485587b88a7fc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.475696:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683604.475706:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a7c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a7cb expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.475717:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8a00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683604.475722:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a7c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88a7cb expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.475732:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a7c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88a7cb expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683604.475739:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a7c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88a7cb expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683604.475758:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683604.475865:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a7c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a7cb expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.475873:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683604.475904:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a7c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a7cb expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.475912:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a7c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a7cb expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683604.475931:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683604.475932:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683604.475934:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683604.476071:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3649:1876618850247424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683604.476145:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683604.476214:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850247424 00000100:00100000:0.0:1789683604.476223:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850247424 00010000:00010000:0.0:1789683604.476250:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0e837dae00/0xcf8485587b88a7cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a7c4 expref: 12 pid: 17195 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683604.476288:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683604.476298:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:3649:x1876618850247424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683604.476312:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683604.476318:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0e837dae00/0xcf8485587b88a7cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a7c4 expref: 12 pid: 17195 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683604.476329:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0e837dae00/0xcf8485587b88a7cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88a7c4 expref: 12 pid: 17195 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683604.476345:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837dae00/0xcf8485587b88a7cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88a7c4 expref: 12 pid: 17195 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683604.476360:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0e837da400/0xcf8485587b88a7fc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683604.476369:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837da400/0xcf8485587b88a7fc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789683604.476392:0:17185:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009891571s 00010000:00010000:0.0:1789683604.476397:0:17185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0e837da400/0xcf8485587b88a7fc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683604.476405:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0e837da400/0xcf8485587b88a7fc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683604.476412:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0e837da400/0xcf8485587b88a7fc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683604.476418:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0e837da400/0xcf8485587b88a7fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683604.476424:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837da400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683604.476428:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0e837da400/0xcf8485587b88a7fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683604.476436:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0e837da400/0xcf8485587b88a7fc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683604.476450:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0e837da400/0xcf8485587b88a7fc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683604.476459:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683604.476495:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+11:3649:x1876618850247424:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683604.476502:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789683604.476531:0:17216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0e837da400/0xcf8485587b88a7fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683604.476548:0:17216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0e837da400/0xcf8485587b88a7fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683604.476555:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837da400/0xcf8485587b88a7fc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683604.478252:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3649:1876618850247424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683604.478440:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17179:1876618850247168:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789683604.478457:0:17179:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789683604.478462:0:17179:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789683604.478464:0:17179:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789683604.478465:0:17179:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683604.478467:0:17179:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683604.478468:0:17179:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683604.478469:0:17179:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683604.478471:0:17179:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789683604.478473:0:17179:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789683604.478475:0:17179:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683604.478477:0:17179:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789683604.478492:0:17179:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1789683604.520649:0:17179:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789683604.521590:0:17179:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789683604.521856:0:17240:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789683604.521860:0:17240:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1789683604.521979:0:17241:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1789683604.522398:0:17241:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789683604.523494:0:17179:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:2.0:1789683604.524045:0:17179:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789683604.524091:0:17179:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789683604.525890:0:17179:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789683604.525909:0:17179:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789683604.525994:0:17179:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683604.533085:0:17241:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789683604.533182:0:17241:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1789683604.535065:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789683604.536537:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789683604.536611:0:17179:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00080000:3.0:1789683604.537145:0:17242:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9f0fc0725880 x1876618850247552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683604.537159:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00080000:10000000:2.0:1789683604.543625:0:17179:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1789683604.552236:0:17179:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789683604.556320:0:17179:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789683604.556367:0:17179:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba8341697988 00100000:10000000:2.0:1789683604.556376:0:17179:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789683604.557772:0:17179:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789683604.557814:0:17179:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789683604.557834:0:17179:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789683604.557858:0:17179:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789683604.558665:0:17179:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789683604.558881:0:17179:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789683605.023399:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789683605.154674:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789683605.154682:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0e83ec0800 from 7 10000000:01000000:2.0:1789683605.154686:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789683605.154735:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88a803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683605.154747:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88a803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683605.154758:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88a803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683605.154813:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850247680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683605.154893:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683605.154960:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8456f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789683605.156696:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850247680 00000100:00100000:1.0:1789683605.156707:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850247680 00000100:00100000:1.0:1789683605.156767:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789683605.156776:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+11:17197:x1876618850247680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683605.156808:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683605.156827:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a80a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a803 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683605.156852:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a80a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a803 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683605.156863:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a80a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a803 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683605.156871:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dbc00, rc 0) 00000100:00100000:1.0:1789683605.156934:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17197:x1876618850247680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (2041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683605.156941:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789683605.156988:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850247680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683605.157004:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88a803 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a80a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683605.157026:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88a803 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a80a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683605.157081:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850247808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789683605.157112:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683605.157137:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85555f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683605.159398:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850247808 00000100:00100000:3.0:1789683605.159412:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850247808 00000100:00100000:3.0:1789683605.159473:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789683605.159485:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17197:x1876618850247808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789683605.159514:0:17195:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789683605.159537:0:17195:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789683605.159540:0:17195:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789683605.159684:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17197:x1876618850247808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 202us (2570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683605.159692:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789683605.164906:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850247808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789683605.165000:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789683605.165012:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88a803 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a80a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683605.165022:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88a803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a80a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789683605.547739:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789683605.600398:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00010000:00010000:3.0:1789683606.048310:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789683606.564959:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789683606.625541:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00010000:00010000:3.0:1789683607.071575:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683607.648125:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00010000:00010000:0.0:1789683608.096284:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683608.673310:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00010000:00010000:3.0:1789683609.119040:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789683609.553003:0:17485:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1789683609.699485:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789683609.699491:0:499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789683609.699494:0:499:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d4f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683609.699502:0:499:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 518 00000100:00080000:3.0:1789683609.699508:0:499:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789683609.699520:0:499:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0e83d4f000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683609.699544:0:499:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc0727100 x1876618850248064/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789683609.699677:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850247936:0@lo:400:kworker.0 00000100:00100000:2.0:1789683609.699762:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683609.699842:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00000100:00080000:3.0:1789683609.705950:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683609.705963:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789683609.705966:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683609.705991:0:499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789683609.705995:0:499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789683609.705998:0:499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789683609.706002:0:499:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdb8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683609.706020:0:499:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f0f8bdb8000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683609.706066:0:499:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc0725f80 x1876618850248192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789683609.706125:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850247936 00000100:00100000:3.0:1789683609.706133:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850247936 00000100:00100000:3.0:1789683609.706206:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789683609.706217:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:3650:x1876618850247936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683609.706318:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:3650:x1876618850247936:12345-0@lo:400:kworker.0 Request processed in 103us (6555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683609.706326:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789683609.706390:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850247936:0@lo:400:kworker.0 00000100:00100000:1.0:1789683609.714182:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850248064:0@lo:38:kworker.0 00000100:00100000:1.0:1789683609.714281:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683609.714349:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850248064 00000100:00100000:1.0:1789683609.714358:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850248064 00000100:00100000:1.0:1789683609.714392:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683609.714400:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850248064:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789683609.714420:0:17206:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789683609.723507:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876618850248192:0@lo:38:kworker.0 00000100:00100000:2.0:1789683609.723591:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683609.725964:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850248192 00000100:00100000:3.0:1789683609.725983:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850248192 00000100:00100000:3.0:1789683609.731370:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683609.731386:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1876618850248192:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789683609.731432:0:17202:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:3.0:1789683609.731488:0:17202:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcf8485587b88a811 00000004:00100000:3.0:1789683609.731514:0:17202:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789683609.731678:0:17202:0:(import.c:65:import_set_state_nolock()) ffff9f0fc17f7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683609.731809:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876618850248192:12345-0@lo:38:kworker.0 Request processed in 423us (8217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683609.731835:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789683609.731974:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0fc0725f80 x1876618850248192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789683609.731994:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789683609.732002:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789683609.732008:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789683609.732011:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdb8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789683609.732018:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876618850248192:0@lo:38:kworker.0 00000100:00100000:1.0:1789683609.742577:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850248064:12345-0@lo:38:kworker.0 Request processed in 28167us (28286us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789683609.742593:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789683609.751836:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d4f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683609.751852:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789683609.751858:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850248064:0@lo:38:kworker.0 00010000:00010000:0.0:1789683610.142965:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789683610.568204:0:17537:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789683610.568400:0:17537:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789683610.719009:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00010000:00010000:3.0:1789683611.167972:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789683611.706085:0:17587:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789683611.706371:0:17587:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789683611.751725:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00010000:00010000:0.0:1789683612.191241:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683612.767357:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00010000:00010000:3.0:1789683613.216766:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683613.790908:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00010000:00010000:0.0:1789683614.239368:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683614.816414:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00000100:00080000:1.0:1789683614.816539:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789683614.816544:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789683614.816547:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d4f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683614.816553:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 523 00000100:00100000:3.0:1789683614.816660:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683614.816673:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3648:1876618850248320:0@lo:400:kworker.0 00000100:00100000:3.0:1789683614.816757:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789683614.816917:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789683614.816930:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0e83d4f000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683614.816959:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb799a300 x1876618850248448/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683614.816981:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683614.816985:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683614.816988:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683614.816991:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789683614.817023:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850248320 00000100:00100000:1.0:1789683614.817031:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850248320 00000100:00100000:1.0:1789683614.817074:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789683614.817083:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:3648:x1876618850248320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683614.817142:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:3648:x1876618850248320:12345-0@lo:400:kworker.0 Request processed in 60us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683614.817150:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789683614.817253:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683614.817262:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850248576:0@lo:400:kworker.0 00000100:00100000:2.0:1789683614.817294:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683614.817366:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850248576 00000100:00100000:1.0:1789683614.817372:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850248576 00000100:00100000:1.0:1789683614.817408:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683614.817415:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850248576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683614.817451:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850248576:12345-0@lo:400:kworker.0 Request processed in 37us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683614.817472:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789683614.817808:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0fb7999f80 x1876618850248576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683614.817823:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850248576:0@lo:400:kworker.0 00000100:00100000:3.0:1789683614.818002:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850248448:0@lo:38:kworker.0 00000100:00100000:3.0:1789683614.818040:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683614.818107:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3648:1876618850248320:0@lo:400:kworker.0 00000100:00100000:2.0:1789683614.818157:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850248448 00000100:00100000:2.0:1789683614.818162:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850248448 00000100:00100000:2.0:1789683614.818192:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789683614.818197:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1876618850248448:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789683614.818229:0:17205:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789683614.845193:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1876618850248448:12345-0@lo:38:kworker.0 Request processed in 26989us (27147us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789683614.845209:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789683614.850619:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d4f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683614.850633:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789683614.850640:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850248448:0@lo:38:kworker.0 00010000:00010000:1.0:1789683615.270152:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683615.839397:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00000100:00100000:2.0:1789683615.854868:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683604/real 1789683604] req@ffff9f0fa7245c00 x1876618850245120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683614 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683615.854908:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fa7245c00 x1876618850245120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683614 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683615.854920:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683604/real 1789683604] req@ffff9f0fa7247480 x1876618850244992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683614 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683615.854932:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fa7247480 x1876618850244992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683614 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789683615.854958:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb240d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683615.854981:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789683615.854986:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850245120:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789683615.854992:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83446000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683615.854997:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789683615.855000:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850244992:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789683615.855182:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789683615.855188:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789683615.855190:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d4f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683615.855195:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 528 00000100:00080000:3.0:1789683615.855201:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789683615.855213:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0e83d4f000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683615.855235:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc0724700 x1876618850248832/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683615.855260:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683615.855264:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789683615.855266:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0e83446000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683615.855269:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 518 00000100:00080000:3.0:1789683615.855272:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789683615.855277:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f0e83446000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683615.855290:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc0727800 x1876618850248960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683615.855298:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683615.855301:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789683615.855302:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0fb240d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683615.855305:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 518 00000100:00080000:3.0:1789683615.855307:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789683615.855311:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0fb240d000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683615.855321:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc0725500 x1876618850249088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789683615.855363:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850249216:0@lo:400:kworker.0 00000100:00100000:3.0:1789683615.855430:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683615.855475:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683615.855481:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850248704:0@lo:400:kworker.0 00000100:00100000:3.0:1789683615.855507:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683615.855553:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850249216 00000100:00100000:3.0:1789683615.855562:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850249216 00000100:00100000:3.0:1789683615.855612:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683615.855627:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850249216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683615.855677:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850249216:12345-0@lo:400:kworker.0 Request processed in 50us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683615.855683:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789683615.855721:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0fc0727b80 x1876618850249216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683615.855733:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850249216:0@lo:400:kworker.0 00000100:00100000:1.0:1789683615.855968:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850248704 00000100:00100000:1.0:1789683615.855973:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850248704 00000100:00100000:1.0:1789683615.856006:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789683615.856013:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:3650:x1876618850248704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683615.856063:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:3650:x1876618850248704:12345-0@lo:400:kworker.0 Request processed in 50us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683615.856186:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789683615.859052:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850248832:0@lo:38:kworker.0 00000100:00100000:2.0:1789683615.859136:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683615.859180:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850248960:0@lo:8:kworker.0 00000400:00000100:2.0:1789683615.859207:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850248960 offset 0 length 520: 4 00000100:00100000:2.0:1789683615.859250:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850249088:0@lo:8:kworker.0 00000400:00000100:2.0:1789683615.859271:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850249088 offset 0 length 520: 4 00000100:00100000:3.0:1789683615.859414:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850248704:0@lo:400:kworker.0 00000100:00100000:0.0:1789683615.872852:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850248832 00000100:00100000:0.0:1789683615.872868:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850248832 00000100:00100000:0.0:1789683615.872923:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789683615.872931:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850248832:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789683615.872955:0:17206:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789683615.873047:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850248832:12345-0@lo:38:kworker.0 Request processed in 115us (13910us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789683615.873054:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789683615.873210:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d4f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789683615.873216:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789683615.873219:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850248832:0@lo:38:kworker.0 00010000:00010000:1.0:1789683616.295060:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789683616.799515:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789683616.872581:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00010000:00010000:1.0:1789683617.310994:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683617.887969:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00010000:00010000:0.0:1789683618.334951:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789683618.888212:0:17932:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789683618.888216:0:17932:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789683618.888217:0:17932:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789683618.888356:0:17932:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0fc04cf800 00000020:01000004:0.0:1789683618.888372:0:17932:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1789683618.888385:0:17932:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789683618.888399:0:17932:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9f0e824099c0) 00000020:00000080:0.0:1789683618.888419:0:17932:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000100:00100000:3.0:1789683618.915671:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00100000:10000000:2.0:1789683618.944044:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789683618.944816:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1789683618.945953:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789683618.946189:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789683618.946714:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789683618.946984:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1789683618.947196:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1789683618.947390:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789683618.947598:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789683618.947772:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789683618.948214:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789683618.948404:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1789683618.948598:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789683618.948806:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789683618.949067:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789683618.949287:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1789683618.949635:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789683618.949923:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789683618.950132:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789683618.950327:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1789683618.950605:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789683618.950874:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789683618.951107:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789683618.951307:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1789683618.951541:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1789683618.951754:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1789683618.952053:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789683618.952248:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1789683618.952459:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789683618.952685:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789683618.952938:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789683618.953125:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1789683618.953343:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789683618.953568:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789683618.957079:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789683618.957377:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789683618.957874:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1789683618.958154:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789683618.958364:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789683618.958588:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1789683618.958813:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789683618.959079:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789683618.959385:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789683618.959617:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789683618.959941:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1789683618.960169:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1789683618.961243:0:17932:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789683618.962065:0:17932:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789683618.962080:0:17932:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789683618.962093:0:17932:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf8485587b88a81f 00000020:01000004:3.0:1789683618.962101:0:17932:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789683618.962135:0:17932:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789683618.962139:0:17932:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789683618.962145:0:17932:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789683618.962173:0:17932:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789683618.962177:0:17932:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1789683618.967358:0:17932:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789683618.967403:0:17932:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.150@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1789683618.967409:0:17932:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789683618.967411:0:17932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789683618.967412:0:17932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683618.967413:0:17932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683618.967414:0:17932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683618.967416:0:17932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683618.967417:0:17932:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789683618.967419:0:17932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683618.967420:0:17932:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789683618.967424:0:17932:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1789683618.967426:0:17932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789683618.967428:0:17932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789683618.967429:0:17932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683618.967430:0:17932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683618.967431:0:17932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683618.967432:0:17932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683618.967433:0:17932:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789683618.967434:0:17932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683618.967435:0:17932:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789683618.967464:0:17932:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789683618.967499:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850249344:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789683618.967588:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683618.967683:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92546000 going to sleep for 11 seconds 00000100:00100000:1.0:1789683618.967972:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850249344 00000100:00100000:1.0:1789683618.967981:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850249344 00000100:00100000:1.0:1789683618.968089:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789683618.968100:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17932:x1876618850249344:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789683618.968138:0:17195:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789683618.968141:0:17195:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1789683618.968150:0:17195:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789683618.968516:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17932:x1876618850249344:12345-0@lo:253:mount.lustre.0 Request processed in 416us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683618.968524:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789683618.968691:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850249344:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789683618.968702:0:17932:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789683618.968705:0:17932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789683618.968706:0:17932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789683618.968707:0:17932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683618.968709:0:17932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683618.968710:0:17932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683618.968711:0:17932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683618.968713:0:17932:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683618.968715:0:17932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683618.968716:0:17932:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789683618.968735:0:17932:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0fc04cf800 from lustre-MDT0001 10000000:01000000:0.0:1789683618.968765:0:17932:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789683618.968768:0:17932:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789683618.968775:0:17932:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f0fb504b380 local copy 00010000:00010000:0.0:1789683618.968831:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a71c expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683618.968953:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850249472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683618.968987:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683618.969200:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b5300 going to sleep for 11 seconds 00000100:00100000:2.0:1789683618.969263:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850249472 00000100:00100000:2.0:1789683618.969269:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850249472 00000100:00100000:1.0:1789683618.969366:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789683618.969374:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17932:x1876618850249472:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683618.969493:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17932:x1876618850249472:12345-0@lo:501:mount.lustre.0 Request processed in 119us (505us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789683618.969502:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789683618.969688:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850249472:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789683618.969702:0:17932:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789683618.969726:0:17932:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789683618.969732:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a71c expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683618.969742:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a71c expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683618.969770:0:17932:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0fc04cf800 10000000:01000000:2.0:1789683618.969775:0:17932:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789683618.969780:0:17932:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9f0fb504b380 10000000:01000000:2.0:1789683618.969812:0:17932:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789683618.969821:0:17932:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9f0fb504b380 from 1 10000000:01000000:2.0:1789683618.969824:0:17932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789683618.969854:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a826 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683618.969862:0:17932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a826 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683618.969872:0:17932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a826 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683618.969887:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850249600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789683618.969919:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683618.969944:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f899ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1789683618.970030:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850249600 00000100:00100000:1.0:1789683618.970037:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850249600 00000100:00100000:1.0:1789683618.970068:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789683618.970075:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+12:17932:x1876618850249600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683618.970084:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683618.970098:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837da200/0xcf8485587b88a82d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a826 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683618.970120:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837da200/0xcf8485587b88a82d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a826 expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683618.970130:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837da200/0xcf8485587b88a82d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a826 expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683618.970139:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da200, rc 0) 00000100:00100000:1.0:1789683618.970176:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+13:17932:x1876618850249600:12345-0@lo:101:mount.lustre.0 Request processed in 102us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683618.970182:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789683618.970283:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850249600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683618.970296:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a826 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a82d expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683618.970305:0:17932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a826 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a82d expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683618.970321:0:17932:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789683618.970337:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a826 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a82d expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683618.970345:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8a00/0xcf8485587b88a826 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a82d expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683618.970353:0:17932:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f0fc04cf800 10000000:01000000:2.0:1789683618.970366:0:17932:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789683618.970369:0:17932:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f0fc04cf800 from 1 10000000:01000000:2.0:1789683618.970371:0:17932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789683618.970386:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9a00/0xcf8485587b88a834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683618.970393:0:17932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9a00/0xcf8485587b88a834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683618.970400:0:17932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9a00/0xcf8485587b88a834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683618.970413:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850249728:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789683618.970439:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683618.970462:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f899ac840 going to sleep for 11 seconds 00000100:00100000:0.0:1789683618.970568:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850249728 00000100:00100000:0.0:1789683618.970573:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850249728 00000100:00100000:0.0:1789683618.970605:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789683618.970612:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+13:17932:x1876618850249728:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683618.970619:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683618.970628:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454cc00/0xcf8485587b88a83b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a834 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683618.970642:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454cc00/0xcf8485587b88a83b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a834 expref: 14 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683618.970657:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454cc00/0xcf8485587b88a83b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a834 expref: 14 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683618.970664:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454cc00, rc 0) 00000100:00100000:0.0:1789683618.970691:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+14:17932:x1876618850249728:12345-0@lo:101:mount.lustre.0 Request processed in 80us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683618.970698:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789683618.970770:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850249728:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683618.970781:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9a00/0xcf8485587b88a834 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a83b expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683618.970823:0:17932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9a00/0xcf8485587b88a834 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a83b expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683618.970835:0:17932:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789683618.970839:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9a00/0xcf8485587b88a834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a83b expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683618.970847:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9a00/0xcf8485587b88a834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a83b expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683618.970853:0:17932:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789683618.970863:0:17932:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789683618.970867:0:17932:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f0fc04cf800 10000000:01000000:2.0:1789683618.970870:0:17932:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789683618.970873:0:17932:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789683618.970875:0:17932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789683618.970890:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b88a842 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683618.970897:0:17932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b88a842 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683618.970904:0:17932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b88a842 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683618.970915:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850249856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789683618.970939:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683618.970960:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f899ac840 going to sleep for 11 seconds 00000100:00100000:0.0:1789683618.971039:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850249856 00000100:00100000:0.0:1789683618.971044:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850249856 00000100:00100000:0.0:1789683618.971071:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789683618.971077:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+14:17932:x1876618850249856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683618.971084:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683618.971093:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454d600/0xcf8485587b88a849 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a842 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683618.971106:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454d600/0xcf8485587b88a849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a842 expref: 15 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683618.971114:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454d600/0xcf8485587b88a849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a842 expref: 15 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683618.971120:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d600, rc 0) 00000100:00100000:0.0:1789683618.971148:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+15:17932:x1876618850249856:12345-0@lo:101:mount.lustre.0 Request processed in 71us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683618.971154:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789683618.971227:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850249856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683618.971238:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b88a842 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a849 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683618.971245:0:17932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b88a842 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a849 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789683618.973257:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1789683618.973958:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683618.977942:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789683618.978011:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789683618.978045:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789683618.978061:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789683618.978075:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1789683618.978090:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1789683618.978103:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1789683618.978117:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789683618.978132:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789683618.978145:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1789683618.978158:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1789683618.978172:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1789683618.978186:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1789683618.978199:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789683618.978210:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1789683618.978223:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1789683618.978235:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1789683618.978247:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1789683618.978262:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1789683618.978274:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1789683618.978287:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1789683618.978300:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789683618.978312:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789683618.978341:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1789683618.978348:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1789683618.978464:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850249984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683618.978781:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683618.979086:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc07b53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683618.979134:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850249984 00000100:00100000:2.0:1789683618.979143:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850249984 00000100:00100000:2.0:1789683618.979227:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789683618.979238:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+15:17932:x1876618850249984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683618.979455:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+15:17932:x1876618850249984:12345-0@lo:501:mount.lustre.0 Request processed in 218us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683618.979478:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789683618.979625:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850249984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683618.979669:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850250112:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683618.979714:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683618.979764:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683618.979867:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850250112 00000100:00100000:2.0:1789683618.979872:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850250112 00000100:00100000:2.0:1789683618.979913:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789683618.979920:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+15:17932:x1876618850250112:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789683618.980769:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+15:17932:x1876618850250112:12345-0@lo:503:mount.lustre.0 Request processed in 846us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683618.980778:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789683618.981013:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850250112:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789683618.981520:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789683618.981618:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850250240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683618.981668:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683618.981713:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683618.981843:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850250240 00000100:00100000:2.0:1789683618.981849:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850250240 00000100:00100000:2.0:1789683618.981879:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789683618.981887:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+15:17932:x1876618850250240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683618.982438:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+15:17932:x1876618850250240:12345-0@lo:502:mount.lustre.0 Request processed in 550us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683618.982446:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789683618.982620:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850250240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789683618.982853:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789683618.982885:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1789683618.982901:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1789683618.982915:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1789683618.982930:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1789683618.982943:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1789683618.982956:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1789683618.982968:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1789683618.982982:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1789683618.982996:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1789683618.983009:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1789683618.983036:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1789683618.983053:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1789683618.983068:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1789683618.983083:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1789683618.983096:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1789683618.983108:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1789683618.983120:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1789683618.983131:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1789683618.983141:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1789683618.983151:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1789683618.983162:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1789683618.983172:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1789683618.983183:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1789683618.983193:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1789683618.983213:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1789683618.983224:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1789683618.983235:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1789683618.983245:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1789683618.983256:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1789683618.983266:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1789683618.983277:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1789683618.983287:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1789683618.983298:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1789683618.983311:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1789683618.983324:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1789683618.983335:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1789683618.983346:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1789683618.983356:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1789683618.983366:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1789683618.983377:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1789683618.983388:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1789683618.983398:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1789683618.983408:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1789683618.983438:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850250368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683618.983737:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683618.983843:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683618.983977:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850250368 00000100:00100000:3.0:1789683618.983984:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850250368 00000100:00100000:2.0:1789683618.984064:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789683618.984074:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+15:17932:x1876618850250368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683618.984177:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+15:17932:x1876618850250368:12345-0@lo:502:mount.lustre.0 Request processed in 105us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683618.984184:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789683618.984265:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850250368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789683618.984319:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1789683618.984330:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1789683618.985074:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683618.985088:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683618.985090:0:17936:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789683618.985096:0:17936:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789683618.985100:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789683618.985114:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9f0fc12419c0) 00000020:00000080:2.0:1789683618.985138:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1789683618.985143:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789683618.985220:0:17936:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789683618.985227:0:17936:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf8485587b88a857 00000020:00000080:2.0:1789683618.985428:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789683618.985432:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683618.985436:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683618.985438:0:17936:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789683618.985441:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683618.985444:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683618.985445:0:17936:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789683618.985448:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789683618.985455:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9f0fc1244d40) 00000020:00000080:2.0:1789683618.985466:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1789683618.985470:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789683618.985472:0:17936:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789683618.985475:0:17936:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789683618.985494:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789683618.985550:0:17936:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0fc04cf800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789683618.985563:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9f0fc1240000) 00000020:00000080:2.0:1789683618.985573:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1789683618.985623:0:17936:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789683618.985630:0:17936:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b88a86c 00000020:00000080:2.0:1789683618.985718:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789683618.985726:0:17936:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789683618.985731:0:17936:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xcf8485587b88a873 00080000:01000000:2.0:1789683618.985736:0:17936:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789683618.985740:0:17936:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf8485587b88a87a 00010000:00010000:0.0:1789683619.040569:0:17936:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1789683619.041289:0:17936:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1789683619.041576:0:17936:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789683619.042758:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789683619.042776:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683619.042814:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683619.042817:0:17936:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789683619.042822:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683619.042846:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683619.042848:0:17936:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789683619.042852:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789683619.042859:0:17936:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:00000080:0.0:1789683619.043060:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789683619.043076:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9f0e82408000) 00000020:00000080:0.0:1789683619.043100:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1789683619.043105:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789683619.043182:0:17936:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789683619.043189:0:17936:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789683619.043196:0:17936:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf8485587b88a888 00010000:00080000:0.0:1789683619.043229:0:17936:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0fc04c8800@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:0.0:1789683619.045258:0:17936:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1789683619.047123:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789683619.047140:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789683619.047179:0:17936:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789683619.047204:0:17936:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b88a88f 00000100:00080000:0.0:1789683619.047215:0:17936:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789683619.047227:0:17936:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f0fc04c8800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789683619.047266:0:17936:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0f88c75f80 x1876618850250496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789683619.047289:0:17936:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789683619.047401:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850250496:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1789683619.048438:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683619.048445:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683619.048448:0:17936:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789683619.048452:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789683619.048456:0:17936:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789683619.048464:0:17936:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789683619.048466:0:17936:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789683619.048468:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789683619.048470:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683619.048471:0:17936:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789683619.048474:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683619.048491:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683619.048493:0:17936:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789683619.048499:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789683619.048547:0:17936:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789683619.048560:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683619.048563:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683619.048565:0:17936:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789683619.048567:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789683619.048569:0:17936:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1789683619.048570:0:17936:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789683619.048571:0:17936:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789683619.048573:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789683619.048576:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683619.048577:0:17936:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789683619.048580:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789683619.048584:0:17936:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789683619.048587:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683619.048589:0:17936:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789683619.048592:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789683619.048597:0:17936:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:0.0:1789683619.048622:0:17936:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789683619.048625:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789683619.048642:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9f0e8240cd40) 00000020:00000080:0.0:1789683619.048663:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789683619.048670:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789683619.048762:0:17936:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789683619.048770:0:17936:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789683619.048799:0:17936:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf8485587b88a89d 00010000:00080000:0.0:1789683619.048835:0:17936:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0f8554b800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:0.0:1789683619.049113:0:17936:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1789683619.049516:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683619.051126:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850250496 00000100:00100000:0.0:1789683619.051137:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850250496 00000100:00100000:0.0:1789683619.051183:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789683619.051192:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1876618850250496:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789683619.051222:0:17206:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:0.0:1789683619.051275:0:17206:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b88a8a4 00000004:00100000:0.0:1789683619.051291:0:17206:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789683619.051298:0:17206:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:2.0:1789683619.053525:0:17936:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789683619.053860:0:17936:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1789683619.055471:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789683619.055480:0:14530:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789683619.055484:0:14530:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d4f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683619.055498:0:14530:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:3.0:1789683619.055503:0:14530:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789683619.055517:0:14530:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0e83d4f000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683619.055554:0:14530:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc0727b80 x1876618850250624/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683619.055577:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683619.055581:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789683619.055583:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683619.055586:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789683619.055604:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850250624:0@lo:38:kworker.0 00000100:00100000:3.0:1789683619.055746:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683619.055817:0:17205:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789683619.055826:0:17205:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1789683619.056587:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850250752:0@lo:400:kworker.0 00000100:00100000:3.0:1789683619.056640:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683619.056664:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850250752 00000100:00100000:0.0:1789683619.056674:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850250752 00000100:00100000:3.0:1789683619.056694:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850250624 00000100:00100000:3.0:1789683619.056698:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850250624 00000100:00100000:0.0:1789683619.056721:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683619.056729:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850250752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683619.056800:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789683619.056800:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850250752:12345-0@lo:400:kworker.0 Request processed in 55us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683619.056805:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1876618850250624:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1789683619.056807:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683619.056851:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1876618850250624:12345-0@lo:38:kworker.0 Request processed in 45us (1105us total) trans 0 rc -11/-11 00010000:00080000:0.0:1789683619.056852:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0fc0726d80 x1876618850250752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683619.056858:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789683619.056865:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850250752:0@lo:400:kworker.0 00000100:00100000:3.0:1789683619.056891:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789683619.056897:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d4f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683619.056902:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789683619.056921:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850250624:0@lo:38:kworker.0 00000100:00080000:0.0:1789683619.059048:0:17206:0:(import.c:65:import_set_state_nolock()) ffff9f0fc06b1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683619.059132:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1876618850250496:12345-0@lo:38:llog_process_th.0 Request processed in 7937us (9615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683619.059143:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:1.0:1789683619.059514:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789683619.060717:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789683619.060730:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789683619.060742:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789683619.060750:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789683619.060754:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc04c8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789683619.060778:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850250496:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789683619.060963:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789683619.061143:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:0.0:1789683619.061613:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683619.061630:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850250880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683619.061703:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683619.061750:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850250880 00000100:00100000:3.0:1789683619.061758:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850250880 00000100:00100000:3.0:1789683619.061828:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683619.061839:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1876618850250880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789683619.061891:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789683619.061949:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1876618850250880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (245us total) trans 0 rc 0/0 00000040:00080000:0.0:1789683619.062041:0:17942:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789683619.062046:0:17942:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789683619.062652:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789683619.062664:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789683619.062716:0:17936:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789683619.062745:0:17936:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b88a8ab 00000100:00080000:1.0:1789683619.062753:0:17936:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789683619.062763:0:17936:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f0f8554b800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683619.062831:0:17936:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb7998700 x1876618850251008/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683619.062854:0:17936:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789683619.062906:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683619.062911:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683619.062913:0:17936:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789683619.062916:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789683619.062919:0:17936:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1789683619.062921:0:17936:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683619.062922:0:17936:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683619.062924:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789683619.062926:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683619.062928:0:17936:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789683619.062930:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789683619.062934:0:17936:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789683619.062938:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683619.062939:0:17936:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789683619.062943:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789683619.062947:0:17936:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:1.0:1789683619.062966:0:17936:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789683619.062969:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789683619.062981:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9f0e83c299c0) 00000020:00000080:1.0:1789683619.062993:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1789683619.062998:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789683619.063066:0:17936:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789683619.063073:0:17936:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789683619.063079:0:17936:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf8485587b88a8b9 00010000:00080000:1.0:1789683619.063108:0:17936:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0f8bdbd000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:1.0:1789683619.063325:0:17936:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789683619.063397:0:17936:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789683619.063414:0:17936:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1789683619.063663:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850251008:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789683619.063715:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850251008 offset 0 length 520: 4 00000040:00080000:1.0:1789683619.065425:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683619.065661:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789683619.065915:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:3.0:1789683619.067453:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789683619.067515:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683619.067520:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789683619.067523:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683619.067526:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789683619.067593:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850250880:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789683619.068159:0:17944:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789683619.068165:0:17944:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789683619.069196:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789683619.069212:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789683619.069262:0:17936:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789683619.069292:0:17936:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b88a8c0 00000100:00080000:1.0:1789683619.069304:0:17936:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789683619.069318:0:17936:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0f8bdbd000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683619.069358:0:17936:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb7998e00 x1876618850251136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789683619.069419:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850251136:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789683619.069476:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850251136 offset 0 length 520: 4 00000100:00080000:1.0:1789683619.069554:0:17936:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789683619.069664:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683619.069669:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789683619.069680:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683619.069683:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1789683619.069760:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683619.069765:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683619.069767:0:17936:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789683619.069770:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683619.069774:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683619.069776:0:17936:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789683619.069779:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789683619.069781:0:17936:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789683619.069807:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683619.069810:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683619.069811:0:17936:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789683619.069814:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683619.069816:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683619.069817:0:17936:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789683619.069821:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789683619.069856:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683619.069859:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683619.069866:0:17936:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789683619.069870:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:1.0:1789683619.069933:0:17932:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1789683619.069968:0:17932:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789683619.069984:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b88a842 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a849 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683619.069995:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8c00/0xcf8485587b88a842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a849 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683619.070002:0:17932:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0fc04cf800 from 1 10000000:01000000:1.0:1789683619.070005:0:17932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789683619.070045:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837daa00/0xcf8485587b88a8c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683619.070053:0:17932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0e837daa00/0xcf8485587b88a8c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683619.070065:0:17932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0e837daa00/0xcf8485587b88a8c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683619.070082:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850251264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789683619.070129:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683619.070180:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85730c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683619.070434:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850251264 00000100:00100000:3.0:1789683619.070443:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850251264 00000100:00100000:3.0:1789683619.070519:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789683619.070529:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+15:17932:x1876618850251264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683619.070544:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683619.070558:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb6176000/0xcf8485587b88a8ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a8c7 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683619.070583:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb6176000/0xcf8485587b88a8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a8c7 expref: 16 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683619.070593:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb6176000/0xcf8485587b88a8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a8c7 expref: 16 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683619.070602:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176000, rc 0) 00000100:00100000:3.0:1789683619.070651:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+16:17932:x1876618850251264:12345-0@lo:101:mount.lustre.0 Request processed in 124us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683619.070658:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789683619.070773:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850251264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683619.070813:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0e837daa00/0xcf8485587b88a8c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a8ce expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683619.070822:0:17932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0e837daa00/0xcf8485587b88a8c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a8ce expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683619.071372:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850251392:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789683619.071416:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683619.071443:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85730c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683619.071539:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850251392 00000100:00100000:3.0:1789683619.071545:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850251392 00000100:00100000:3.0:1789683619.071584:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789683619.071591:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+16:17932:x1876618850251392:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789683619.071608:0:17193:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789683619.071628:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789683619.071631:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789683619.071715:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+16:17932:x1876618850251392:12345-0@lo:256:mount.lustre.0 Request processed in 124us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683619.071727:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789683619.071900:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850251392:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789683619.072467:0:17932:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789683619.072541:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837daa00/0xcf8485587b88a8c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a8ce expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683619.072552:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0e837daa00/0xcf8485587b88a8c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a8ce expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683619.072561:0:17932:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0fc04cf800 from 1 10000000:01000000:1.0:1789683619.072564:0:17932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789683619.072591:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837da800/0xcf8485587b88a8d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683619.072599:0:17932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0e837da800/0xcf8485587b88a8d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683619.072608:0:17932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0e837da800/0xcf8485587b88a8d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683619.072623:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850251520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789683619.072657:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683619.072688:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85730c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683619.072877:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850251520 00000100:00100000:0.0:1789683619.072883:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850251520 00000100:00100000:0.0:1789683619.072923:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789683619.072931:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+16:17932:x1876618850251520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683619.072940:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683619.072952:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454d800/0xcf8485587b88a8dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a8d5 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.072973:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454d800/0xcf8485587b88a8dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a8d5 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.072984:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454d800/0xcf8485587b88a8dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a8d5 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.072992:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d800, rc 0) 00000100:00100000:0.0:1789683619.073040:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17932:x1876618850251520:12345-0@lo:101:mount.lustre.0 Request processed in 110us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683619.073047:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789683619.073206:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850251520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683619.073281:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0e837da800/0xcf8485587b88a8d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a8dc expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683619.073290:0:17932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0e837da800/0xcf8485587b88a8d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a8dc expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789683619.073419:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789683619.073448:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850251648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683619.073477:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683619.073604:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85730f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683619.073684:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850251648 00000100:00100000:0.0:1789683619.073689:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850251648 00000100:00100000:0.0:1789683619.073730:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789683619.073737:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17932:x1876618850251648:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683619.073915:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17932:x1876618850251648:12345-0@lo:501:mount.lustre.0 Request processed in 178us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683619.073923:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789683619.074075:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850251648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683619.074115:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850251776:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789683619.074158:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683619.074186:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8456ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683619.074237:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850251776 00000100:00100000:0.0:1789683619.074242:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850251776 00000100:00100000:0.0:1789683619.074273:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789683619.074280:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17932:x1876618850251776:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683619.074410:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17932:x1876618850251776:12345-0@lo:503:mount.lustre.0 Request processed in 130us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683619.074417:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789683619.074610:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850251776:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789683619.075121:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789683619.075199:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850251904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683619.075244:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683619.075312:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8456ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683619.075350:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850251904 00000100:00100000:0.0:1789683619.075355:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850251904 00000100:00100000:0.0:1789683619.075427:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789683619.075435:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17932:x1876618850251904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683619.075531:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17932:x1876618850251904:12345-0@lo:502:mount.lustre.0 Request processed in 96us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683619.075538:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789683619.075602:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850251904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789683619.075831:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789683619.075858:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1789683619.075874:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1789683619.075888:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1789683619.075900:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1789683619.075913:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1789683619.075927:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1789683619.075942:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1789683619.075956:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789683619.075967:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:2.0:1789683619.075980:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:2.0:1789683619.076002:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850252032:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683619.076072:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683619.076269:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8456ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683619.076348:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850252032 00000100:00100000:1.0:1789683619.076355:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850252032 00000100:00100000:1.0:1789683619.076382:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789683619.076389:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17932:x1876618850252032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683619.076583:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17932:x1876618850252032:12345-0@lo:502:mount.lustre.0 Request processed in 194us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683619.076591:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789683619.076679:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850252032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789683619.076723:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:2.0:1789683619.076732:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789683619.077288:0:17946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683619.077298:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683619.077300:0:17946:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789683619.077307:0:17946:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0fc04cf800 00000020:00000080:1.0:1789683619.077309:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789683619.077317:0:17946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683619.077320:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683619.077321:0:17946:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789683619.077323:0:17946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683619.077326:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683619.077327:0:17946:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789683619.077330:0:17946:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0fc04cf800 00000020:00000080:1.0:1789683619.077339:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789683619.077431:0:17946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683619.077434:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683619.077436:0:17946:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789683619.077438:0:17946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683619.077441:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683619.077443:0:17946:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789683619.077447:0:17946:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0fc04cf800 00000020:00000080:1.0:1789683619.077448:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789683619.077862:0:17946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683619.077866:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683619.077867:0:17946:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789683619.077870:0:17946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683619.077872:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683619.077873:0:17946:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789683619.077876:0:17946:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0fc04cf800 00000020:00000080:1.0:1789683619.077877:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789683619.077902:0:17946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683619.077904:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683619.077905:0:17946:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789683619.077908:0:17946:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1789683619.082608:0:17932:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789683619.082661:0:17932:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683619.082729:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837da800/0xcf8485587b88a8d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a8dc expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683619.082743:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0e837da800/0xcf8485587b88a8d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a8dc expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683619.082842:0:17932:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789683619.082845:0:17932:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0fc04cf800 10000000:01000000:2.0:1789683619.082848:0:17932:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0fc04cf800 10000000:01000000:2.0:1789683619.082851:0:17932:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789683619.082856:0:17932:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0fc04cf800 from 1 10000000:01000000:2.0:1789683619.082858:0:17932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789683619.082895:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b88a8e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683619.082903:0:17932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b88a8e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683619.082915:0:17932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b88a8e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683619.082940:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850252160:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789683619.083008:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683619.083057:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8456f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683619.086237:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850252160 00000100:00100000:0.0:1789683619.086251:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850252160 00000100:00100000:0.0:1789683619.086314:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789683619.086324:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17932:x1876618850252160:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683619.086341:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683619.086360:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454c600/0xcf8485587b88a8ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a8e3 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.086399:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454c600/0xcf8485587b88a8ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a8e3 expref: 18 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.086409:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454c600/0xcf8485587b88a8ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a8e3 expref: 18 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.086418:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454c600, rc 0) 00000100:00100000:0.0:1789683619.087629:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17932:x1876618850252160:12345-0@lo:101:mount.lustre.0 Request processed in 1301us (4615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683619.087640:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789683619.093704:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850252160:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683619.093734:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b88a8e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a8ea expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683619.093760:0:17932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b88a8e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a8ea expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789683619.105594:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789683619.105917:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683619.106136:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789683619.106160:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1789683619.106174:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1789683619.106187:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1789683619.106198:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1789683619.106210:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1789683619.106222:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1789683619.106234:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1789683619.106247:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1789683619.106258:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1789683619.106270:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1789683619.106282:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1789683619.106294:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1789683619.106307:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1789683619.106321:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1789683619.106334:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1789683619.106359:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1789683619.106375:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1789683619.106387:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1789683619.106398:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1789683619.106409:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1789683619.106423:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1789683619.106436:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1789683619.106451:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1789683619.106464:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1789683619.106479:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1789683619.106707:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1789683619.106723:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1789683619.106754:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1789683619.106759:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1789683619.108088:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850252288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683619.108164:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683619.108244:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc14f1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683619.114776:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850252288 00000100:00100000:2.0:1789683619.115588:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850252288 00000100:00100000:2.0:1789683619.116598:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789683619.116612:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8652d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17932:x1876618850252288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683619.116811:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8652d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17932:x1876618850252288:12345-0@lo:501:mount.lustre.0 Request processed in 202us (8646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683619.116819:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789683619.116932:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850252288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683619.116982:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850252416:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789683619.117037:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683619.117147:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88818540 going to sleep for 11 seconds 00000100:00100000:0.0:1789683619.117737:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850252416 00000100:00100000:0.0:1789683619.117745:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850252416 00000100:00100000:0.0:1789683619.117779:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789683619.118046:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8652ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17932:x1876618850252416:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683619.118201:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8652ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17932:x1876618850252416:12345-0@lo:503:mount.lustre.0 Request processed in 159us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683619.118328:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850252416:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789683619.120160:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789683619.120265:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850252544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683619.120333:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683619.120366:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88818540 going to sleep for 11 seconds 00000100:00100000:0.0:1789683619.120557:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789683619.120609:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850252544 00000100:00100000:0.0:1789683619.120615:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850252544 00000100:00100000:0.0:1789683619.120657:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789683619.120667:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8652fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17932:x1876618850252544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683619.120804:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8652fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17932:x1876618850252544:12345-0@lo:502:mount.lustre.0 Request processed in 139us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683619.120812:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789683619.120957:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850252544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789683619.121161:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1789683619.121188:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1789683619.121202:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1789683619.121214:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1789683619.121226:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1789683619.121238:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1789683619.121250:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1789683619.121262:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1789683619.121274:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1789683619.121288:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1789683619.121301:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1789683619.121316:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1789683619.121342:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1789683619.121356:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1789683619.121384:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1789683619.121401:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1789683619.121413:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1789683619.121427:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1789683619.121438:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1789683619.121449:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1789683619.121462:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1789683619.121473:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1789683619.121559:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1789683619.121577:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1789683619.121591:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1789683619.121604:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1789683619.121617:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1789683619.121630:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1789683619.121642:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1789683619.121654:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1789683619.121679:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1789683619.121695:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1789683619.121707:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1789683619.121719:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1789683619.121731:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1789683619.121743:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1789683619.121755:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1789683619.121767:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1789683619.121778:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1789683619.122025:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1789683619.122043:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1789683619.122056:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1789683619.122068:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1789683619.122081:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1789683619.122093:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1789683619.122115:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1789683619.122140:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1789683619.122154:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1789683619.122193:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850252672:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683619.122239:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683619.122267:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88818540 going to sleep for 11 seconds 00000100:00100000:3.0:1789683619.122285:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850252672 00000100:00100000:3.0:1789683619.122290:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850252672 00000100:00100000:3.0:1789683619.122362:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789683619.122370:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8f78f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17932:x1876618850252672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683619.122459:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8f78f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17932:x1876618850252672:12345-0@lo:502:mount.lustre.0 Request processed in 89us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683619.122466:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789683619.123324:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850252672:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789683619.123574:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1789683619.123598:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1789683619.123624:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850252800:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683619.123668:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683619.123704:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88818540 going to sleep for 11 seconds 00000100:00100000:2.0:1789683619.123755:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850252800 00000100:00100000:2.0:1789683619.123761:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850252800 00000100:00100000:2.0:1789683619.123823:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789683619.123831:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8f78fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17932:x1876618850252800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683619.123935:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8f78fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17932:x1876618850252800:12345-0@lo:502:mount.lustre.0 Request processed in 104us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683619.123942:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789683619.124040:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850252800:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789683619.124093:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1789683619.124102:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789683619.124829:0:17953:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789683619.124845:0:17953:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9f0fa50899c0) 00000020:00000080:3.0:1789683619.124864:0:17953:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789683619.124959:0:17953:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0fc04cf800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789683619.124963:0:17953:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0fc04cf800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789683619.124966:0:17953:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0fc04cf800 3 00010000:00080000:3.0:1789683619.124996:0:17953:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0fc0507800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:3.0:1789683619.129367:0:17953:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1789683619.131665:0:17953:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789683619.131720:0:17953:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789683619.131732:0:17953:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xcf8485587b88a8f8 00000100:00080000:3.0:1789683619.131742:0:17953:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683619.131752:0:17953:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f0fc0507800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683619.131795:0:17953:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc0727480 x1876618850252928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789683619.131833:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876618850252928:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789683619.131895:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683619.131953:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850252928 00000100:00100000:3.0:1789683619.131959:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850252928 00000100:00100000:3.0:1789683619.131990:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683619.131998:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1876618850252928:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789683619.132034:0:17201:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:3.0:1789683619.132065:0:17201:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcf8485587b88a8ff 00000004:00100000:3.0:1789683619.132082:0:17201:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789683619.132132:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9f0f86d65800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683619.132182:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876618850252928:12345-0@lo:38:llog_process_th.0 Request processed in 183us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683619.132190:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789683619.132228:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0fc0727480 x1876618850252928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683619.132238:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789683619.132246:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789683619.132253:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789683619.132258:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789683619.132260:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fc0507800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789683619.132276:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876618850252928:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789683619.132295:0:17953:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789683619.132317:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683619.132322:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789683619.132325:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683619.132328:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1789683619.136285:0:17953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:0.0:1789683619.136417:0:17932:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789683619.136449:0:17932:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789683619.136475:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b88a8e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a8ea expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.136495:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8200/0xcf8485587b88a8e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a8ea expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789683619.136542:0:17932:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789683619.136545:0:17932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789683619.136546:0:17932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683619.136547:0:17932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683619.136549:0:17932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683619.136550:0:17932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683619.136551:0:17932:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683619.136553:0:17932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683619.136554:0:17932:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789683619.136558:0:17932:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1789683619.136561:0:17932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789683619.136562:0:17932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789683619.136563:0:17932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683619.136564:0:17932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683619.136565:0:17932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683619.136566:0:17932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683619.136567:0:17932:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683619.136568:0:17932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683619.136569:0:17932:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789683619.136596:0:17932:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789683619.136615:0:17932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850253056:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789683619.136690:0:17932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683619.136727:0:17932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83c83c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683619.136748:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850253056 00000100:00100000:0.0:1789683619.136761:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850253056 00000100:00100000:0.0:1789683619.136827:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789683619.136835:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc037b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17932:x1876618850253056:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789683619.136864:0:17193:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789683619.136877:0:17193:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789683619.142297:0:17180:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789683619.142340:0:17193:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789683619.142350:0:17193:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789683619.142416:0:17216:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789683619.142421:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789683619.142444:0:17216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88a906 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.142463:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a80a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a803 expref: 18 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.142469:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fb6176000/0xcf8485587b88a8ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a8c7 expref: 18 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.142482:0:17216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88a906 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.142522:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fb6176000/0xcf8485587b88a8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88a8c7 expref: 18 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.142536:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0fb6176000/0xcf8485587b88a8ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88a8c7 expref: 18 pid: 17195 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683619.142549:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1876618850253184:0@lo:104: 00000100:00100000:0.0:1789683619.142612:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789683619.142658:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a80a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88a803 expref: 18 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.142677:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a80a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88a803 expref: 18 pid: 17193 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683619.142686:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1876618850253312:0@lo:104: 00000100:00100000:0.0:1789683619.142709:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683619.142734:0:17216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683619.142808:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850253184 00000100:00100000:0.0:1789683619.142816:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850253184 00000100:00100000:0.0:1789683619.142851:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850253312 00000100:00100000:0.0:1789683619.142853:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850253312 00000100:00100000:0.0:1789683619.142866:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683619.142874:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+4:17216:x1876618850253184:12345-0@lo:104: 00010000:00010000:0.0:1789683619.142886:0:17184:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0e837daa00/0xcf8485587b88a8c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a8ce expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.142941:0:17184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789683619.142947:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+4:17216:x1876618850253184:12345-0@lo:104: Request processed in 74us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683619.142955:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683619.142971:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683619.142977:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+3:17216:x1876618850253312:12345-0@lo:104: 00010000:00010000:0.0:1789683619.142985:0:17184:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88a803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a80a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.143188:0:17184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789683619.143194:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+3:17216:x1876618850253312:12345-0@lo:104: Request processed in 217us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683619.143210:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789683619.143229:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683619.143234:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0e837daa00/0xcf8485587b88a8c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a8ce expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.143243:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837daa00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683619.143247:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837daa00/0xcf8485587b88a8c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88a8ce expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.143256:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0e837daa00/0xcf8485587b88a8c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88a8ce expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683619.143263:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837daa00/0xcf8485587b88a8c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88a8ce expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683619.143269:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789683619.143293:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0e837daa00/0xcf8485587b88a8c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a8ce expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.143300:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683619.143325:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0e837daa00/0xcf8485587b88a8c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a8ce expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.143332:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0e837daa00/0xcf8485587b88a8c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a8ce expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.143345:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683619.143349:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88a803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a80a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.143365:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9000 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683619.143368:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88a803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88a80a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.143375:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88a803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88a80a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683619.143382:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88a803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88a80a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683619.143387:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789683619.143399:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88a803 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a80a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.143405:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683619.143412:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88a803 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a80a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.143419:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88a803 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a80a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.143431:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683619.143433:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683619.143435:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683619.143463:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1876618850253184:0@lo:104: 00000100:00100000:0.0:1789683619.143472:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1876618850253312:0@lo:104: 00010000:00010000:0.0:1789683619.143489:0:17216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88a906 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683619.143716:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc037b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17932:x1876618850253056:12345-0@lo:253:mount.lustre.0 Request processed in 6881us (7026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683619.143726:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789683619.143769:0:17932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17932:1876618850253056:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789683619.143780:0:17932:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789683619.143803:0:17932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789683619.143805:0:17932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789683619.143806:0:17932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683619.143808:0:17932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683619.143810:0:17932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683619.143811:0:17932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683619.143813:0:17932:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683619.143815:0:17932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683619.143816:0:17932:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789683619.143828:0:17932:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789683619.146235:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683619.146272:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850253568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683619.146338:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683619.146416:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683619.146423:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850253440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683619.146445:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683619.150855:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850253568 00000100:00100000:1.0:1789683619.150869:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850253568 00010000:00010000:1.0:1789683619.150910:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a80a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a803 expref: 18 pid: 17193 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683619.150979:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850253440 00000100:00100000:1.0:1789683619.150983:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850253440 00010000:00010000:1.0:1789683619.150996:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fb6176000/0xcf8485587b88a8ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a8c7 expref: 19 pid: 17195 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683619.151069:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683619.151081:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+19:3650:x1876618850253568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683619.151096:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683619.151102:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a80a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a803 expref: 19 pid: 17193 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.151115:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a80a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88a803 expref: 19 pid: 17193 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.151134:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a80a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88a803 expref: 19 pid: 17193 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.151149:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683619.151210:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:3650:x1876618850253568:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (4872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683619.151232:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683619.151250:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683619.151257:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0724380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:3650:x1876618850253440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683619.151265:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683619.151270:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fb6176000/0xcf8485587b88a8ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a8c7 expref: 17 pid: 17195 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.151280:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fb6176000/0xcf8485587b88a8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88a8c7 expref: 17 pid: 17195 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.151290:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb6176000/0xcf8485587b88a8ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88a8c7 expref: 17 pid: 17195 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.151301:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88a906 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.151309:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88a906 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789683619.151324:0:17186:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009891571s 00010000:00010000:0.0:1789683619.151329:0:17186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88a906 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.151335:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88a906 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.151342:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88a906 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.151349:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88a906 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.151362:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454c800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683619.151368:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88a906 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.151376:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88a906 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.151392:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88a906 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.151403:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683619.151428:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0724380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+16:3650:x1876618850253440:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (4982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683619.151434:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789683619.152626:0:17216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88a906 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.152637:0:17216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88a906 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683619.152644:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f8454c800/0xcf8485587b88a906 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683619.152696:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850253440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683619.152708:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850253568:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1789683619.154616:0:17932:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1789683619.154946:0:17959:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789683619.155357:0:17932:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1789683619.155672:0:17959:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789683619.158098:0:17960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17960:1876618850253696:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789683619.158193:0:17960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683619.158238:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850253696 00000100:00100000:0.0:1789683619.158246:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850253696 00000100:00100000:0.0:1789683619.158297:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789683619.158306:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17960:x1876618850253696:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789683619.158378:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17960:x1876618850253696:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 72us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683619.158386:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789683619.158412:0:17960:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e92c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683619.158435:0:17960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17960:1876618850253696:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789683619.158463:0:17960:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789683619.158515:0:17960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17960:1876618850253824:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789683619.158543:0:17960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683619.158556:0:17960:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e92c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683619.158677:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850253824 00000100:00100000:3.0:1789683619.158683:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850253824 00000100:00100000:3.0:1789683619.158714:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789683619.158721:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17960:x1876618850253824:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789683619.158842:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17960:x1876618850253824:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 121us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683619.158849:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:01000000:3.0:1789683619.158984:0:17932:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789683619.159034:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789683619.159453:0:17932:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789683619.159460:0:17932:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789683619.161085:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789683619.161180:0:17959:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1789683619.161447:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683619.162475:0:17932:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:2.0:1789683619.162702:0:17958:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1789683619.162709:0:17958:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789683619.162855:0:17960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17960:1876618850253824:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789683619.162958:0:17960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17960:1876618850253952:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789683619.163031:0:17960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683619.163070:0:17960:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e92480 going to sleep for 11 seconds 00000100:00100000:1.0:1789683619.163275:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850253952 00000100:00100000:1.0:1789683619.163282:0:17211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850253952 00000040:00080000:3.0:1789683619.163953:0:17932:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789683619.163982:0:17932:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789683619.164172:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789683619.164689:0:17932:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:1.0:1789683619.165008:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683619.165034:0:17211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17960:x1876618850253952:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789683619.165363:0:17211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17960:x1876618850253952:12345-0@lo:900:lod0001_rec0000.0 Request processed in 344us (2331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683619.165372:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789683619.165601:0:17960:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0f88c77100 x1876618850253952/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789683635 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683619.165616:0:17960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17960:1876618850253952:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789683619.165687:0:17960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17960:1876618850254080:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789683619.165729:0:17960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683619.165761:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850254080 00000100:00100000:0.0:1789683619.165776:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850254080 00000100:00100000:0.0:1789683619.165842:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789683619.165850:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17960:x1876618850254080:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789683619.165908:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17960:x1876618850254080:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 59us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683619.165915:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789683619.165933:0:17960:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e92c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683619.165945:0:17960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17960:1876618850254080:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1789683619.165987:0:17960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683619.168152:0:17960:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789683619.168244:0:17960:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789683619.168249:0:17960:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1789683619.169940:0:17932:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789683619.180124:0:17932:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789683619.180167:0:17932:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffba8340d7f988 00100000:10000000:3.0:1789683619.180175:0:17932:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1789683619.181741:0:17932:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789683619.181773:0:17932:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789683619.181807:0:17932:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789683619.181827:0:17932:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789683619.193474:0:17932:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789683619.193954:0:17932:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789683619.360464:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683619.935039:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00000040:00080000:3.0:1789683620.130859:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789683620.388867:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683620.959360:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 10000000:01000000:2.0:1789683621.087464:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789683621.087471:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0fc04cf800 from 8 10000000:01000000:2.0:1789683621.087476:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789683621.087525:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b88a90d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683621.087554:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b88a90d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683621.087568:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b88a90d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683621.087595:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850254208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683621.087678:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683621.087734:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f899acd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683621.089412:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850254208 00000100:00100000:3.0:1789683621.089426:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850254208 00000100:00100000:3.0:1789683621.089494:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789683621.089505:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+16:17197:x1876618850254208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683621.089523:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683621.089545:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88a914 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a90d expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683621.089571:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88a914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a90d expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683621.089582:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88a914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a90d expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683621.089591:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176600, rc 0) 00000100:00100000:3.0:1789683621.089681:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17197:x1876618850254208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (2003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683621.089688:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789683621.089924:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850254208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683621.089942:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b88a90d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a914 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683621.089951:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b88a90d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a914 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683621.090029:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850254336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789683621.090069:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683621.090095:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e37e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683621.092408:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850254336 00000100:00100000:0.0:1789683621.092422:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850254336 00000100:00100000:0.0:1789683621.092478:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789683621.092488:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17197:x1876618850254336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789683621.092512:0:17195:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789683621.092531:0:17195:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789683621.092534:0:17195:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789683621.092660:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17197:x1876618850254336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 172us (2588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683621.092668:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789683621.093170:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850254336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789683621.093233:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789683621.093244:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b88a90d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a914 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683621.093255:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b88a90d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a914 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683621.094695:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789683621.094702:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0e83ec0800 from 8 10000000:01000000:3.0:1789683621.094706:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789683621.094749:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a91b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683621.094760:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a91b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683621.094806:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a91b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683621.094838:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850254464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789683621.094924:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683621.094968:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85394180 going to sleep for 11 seconds 00000100:00100000:0.0:1789683621.099073:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850254464 00000100:00100000:0.0:1789683621.099091:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850254464 00000100:00100000:0.0:1789683621.099155:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789683621.099166:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc037b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17197:x1876618850254464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683621.099184:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683621.099209:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454da00/0xcf8485587b88a922 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a91b expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683621.099238:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454da00/0xcf8485587b88a922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a91b expref: 18 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683621.099250:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454da00/0xcf8485587b88a922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a91b expref: 18 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683621.099260:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454da00, rc 0) 00000100:00100000:0.0:1789683621.099362:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc037b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17197:x1876618850254464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (4437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683621.099369:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789683621.100113:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850254464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683621.100137:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a91b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a922 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683621.100149:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a91b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a922 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683621.100217:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850254592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789683621.100259:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683621.100287:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85394180 going to sleep for 11 seconds 00000100:00100000:0.0:1789683621.104156:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850254592 00000100:00100000:0.0:1789683621.104172:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850254592 00000100:00100000:0.0:1789683621.104242:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789683621.104253:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17197:x1876618850254592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789683621.104288:0:17194:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789683621.104311:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789683621.104314:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789683621.104453:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17197:x1876618850254592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 202us (4191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683621.104460:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789683621.104590:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850254592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789683621.104639:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789683621.104649:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a91b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a922 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683621.104659:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a91b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a922 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789683621.160874:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789683621.407190:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683621.983731:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00010000:00010000:2.0:1789683622.431925:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683623.006941:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00010000:00010000:0.0:1789683623.462759:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683624.035051:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 0 seconds 00010000:00010000:0.0:1789683624.481497:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683624.544036:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850254720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683624.544113:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683624.544249:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850254720 00000100:00100000:2.0:1789683624.544258:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850254720 00000100:00100000:2.0:1789683624.544320:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789683624.544330:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850254720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683624.544628:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789683624.544687:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850254720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 357us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683624.544711:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789683624.544909:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850254720:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1789683624.545056:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789683624.545060:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789683624.545064:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d4f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789683624.545078:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0e83d4f000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789683624.545108:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0f88c77480 x1876618850254976/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789683624.545127:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789683624.545131:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789683624.545134:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789683624.545137:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789683624.545157:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789683624.545160:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789683624.545162:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789683624.545165:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789683624.545192:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850254976:0@lo:38:kworker.0 00000100:00100000:3.0:1789683624.545361:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3648:1876618850254848:0@lo:400:kworker.0 00000100:00100000:2.0:1789683624.545423:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850255104:0@lo:400:kworker.0 00000100:00100000:0.0:1789683624.545452:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683624.556862:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683624.556964:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850254976 00000100:00100000:3.0:1789683624.556975:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850254976 00000100:00100000:3.0:1789683624.557027:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683624.557035:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1876618850254976:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789683624.557069:0:17205:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:3.0:1789683624.557108:0:17205:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b88a929 00000004:00100000:3.0:1789683624.557124:0:17205:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789683624.557130:0:17205:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1789683624.557208:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850254848 00000100:00100000:3.0:1789683624.557212:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850254848 00000100:00100000:3.0:1789683624.557258:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789683624.557264:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc037a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:3648:x1876618850254848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683624.557315:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc037a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:3648:x1876618850254848:12345-0@lo:400:kworker.0 Request processed in 50us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683624.557321:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789683624.557376:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3648:1876618850254848:0@lo:400:kworker.0 00000100:00100000:2.0:1789683624.559276:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683624.559321:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683624.559333:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850255232:0@lo:400:kworker.0 00000100:00100000:2.0:1789683624.559367:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683624.559961:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850255104 00000100:00100000:2.0:1789683624.559973:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850255104 00000100:00100000:2.0:1789683624.560021:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850255232 00000100:00100000:2.0:1789683624.560025:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850255232 00000100:00100000:2.0:1789683624.560042:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683624.560050:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850255104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683624.560111:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850255104:12345-0@lo:400:kworker.0 Request processed in 61us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683624.560118:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683624.560135:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789683624.560141:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850255232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683624.560173:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850255232:12345-0@lo:400:kworker.0 Request processed in 32us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683624.560178:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789683624.560458:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0f88c76d80 x1876618850255232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683624.560474:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850255232:0@lo:400:kworker.0 00010000:00080000:2.0:1789683624.560489:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0f88c74000 x1876618850255104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683624.560519:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850255104:0@lo:400:kworker.0 00000100:00080000:0.0:1789683624.590979:0:17205:0:(import.c:65:import_set_state_nolock()) ffff9f0f86d6c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683624.591094:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876618850254976:12345-0@lo:38:kworker.0 Request processed in 34056us (45637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683624.591106:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789683624.591181:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789683624.591193:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789683624.591200:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789683624.593041:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83d4f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789683624.593073:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000148e8ff0): req@ffff9f0fc0725880 x1876618850247552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683624.593111:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850254976:0@lo:38:kworker.0 00000100:00100000:2.0:1789683624.593470:0:17242:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683624.593526:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 11 seconds 00000100:00100000:2.0:1789683624.594462:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850255360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789683624.594503:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683624.594589:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850247552 00000100:00100000:0.0:1789683624.594599:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850247552 00000100:00100000:0.0:1789683624.594647:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850255360 00000100:00100000:0.0:1789683624.594650:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850255360 00000100:00100000:0.0:1789683624.594668:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789683624.594676:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17242:x1876618850247552:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789683624.594774:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17242:x1876618850247552:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 98us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683624.594811:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789683624.594831:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789683624.594838:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876618850255360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789683624.594864:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789683624.605593:0:17242:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17242:1876618850247552:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1789683624.605650:0:17242:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789683624.605708:0:17242:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17242:1876618850255488:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789683624.605797:0:17242:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683624.605843:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c280840 going to sleep for 11 seconds 00000100:00100000:1.0:1789683624.605863:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850255488 00000100:00100000:1.0:1789683624.605869:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850255488 00000100:00100000:1.0:1789683624.605912:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789683624.605935:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17242:x1876618850255488:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789683624.606071:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17242:x1876618850255488:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 137us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683624.606078:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789683624.606111:0:17242:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17242:1876618850255488:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789683624.606185:0:17242:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17242:1876618850255616:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789683624.606231:0:17242:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683624.606246:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789683624.606272:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850255616 00000100:00100000:1.0:1789683624.606277:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850255616 00000100:00100000:1.0:1789683624.606298:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789683624.606304:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17242:x1876618850255616:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789683624.606353:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17242:x1876618850255616:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 49us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683624.606359:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789683624.606384:0:17242:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17242:1876618850255616:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1789683624.606423:0:17242:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683624.608419:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789683624.608504:0:17242:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:1.0:1789683624.608509:0:17242:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:0.0:1789683624.610420:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876618850255360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 15569us (15902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683624.610438:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789683624.616615:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850255360:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1789683625.034122:0:18203:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789683625.511045:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789683626.015600:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1789683626.325325:0:18255:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789683626.325502:0:18255:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789683626.535381:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789683627.460714:0:18306:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789683627.462014:0:18306:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789683627.551329:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683628.580014:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789683628.632758:0:18355:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5ac0bb60 20000000:00000080:3.0:1789683628.632777:0:18355:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0f86d59c00 uarg=0000000000000000 20000000:01000000:3.0:1789683628.632871:0:18355:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789683628.632879:0:18355:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789683628.632884:0:18355:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789683628.633575:0:18356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1789683628.634022:0:18355:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789683628.649699:0:18355:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789683628.649749:0:18355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a930 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683628.649769:0:18355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0e837da600/0xcf8485587b88a7d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a7d2 expref: 17 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683628.649776:0:18355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f8454d800/0xcf8485587b88a8dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a8d5 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683628.649832:0:18355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a930 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683628.649890:0:18355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f8454d800/0xcf8485587b88a8dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88a8d5 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683628.649921:0:18355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0f8454d800/0xcf8485587b88a8dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88a8d5 expref: 17 pid: 17194 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683628.649938:0:18355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18355:1876618850255744:0@lo:104: 00000100:00100000:1.0:1789683628.650007:0:18355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683628.650063:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850255744 00000100:00100000:1.0:1789683628.650071:0:17183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850255744 00000100:00100000:1.0:1789683628.650119:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683628.650128:0:17183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+3:18355:x1876618850255744:12345-0@lo:104: 00010000:00010000:1.0:1789683628.650141:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0e837da800/0xcf8485587b88a8d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a8dc expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683628.650187:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683628.650193:0:17183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+3:18355:x1876618850255744:12345-0@lo:104: Request processed in 66us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683628.650200:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789683628.650250:0:18355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0e837da600/0xcf8485587b88a7d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88a7d2 expref: 17 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683628.650258:0:18355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0e837da600/0xcf8485587b88a7d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88a7d2 expref: 17 pid: 17195 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683628.650267:0:18355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18355:1876618850255872:0@lo:104: 00000100:00100000:1.0:1789683628.650288:0:18355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683628.650307:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850255872 00010000:00010000:0.0:1789683628.650767:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683628.650775:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0e837da800/0xcf8485587b88a8d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a8dc expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683628.650802:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837da800 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:0.0:1789683628.650806:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837da800/0xcf8485587b88a8d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88a8dc expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683628.650815:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0e837da800/0xcf8485587b88a8d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88a8dc expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683628.650831:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837da800/0xcf8485587b88a8d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88a8dc expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683628.650837:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789683628.650879:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0e837da800/0xcf8485587b88a8d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a8dc expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683628.650890:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683628.650913:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0e837da800/0xcf8485587b88a8d5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a8dc expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683628.650919:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0e837da800/0xcf8485587b88a8d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a8dc expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683628.650937:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683628.650938:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683628.650940:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683628.651108:0:17183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850255872 00000100:00100000:2.0:1789683628.651235:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683628.651248:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850256000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683628.651264:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789683628.651271:0:17183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7999f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+3:18355:x1876618850255872:12345-0@lo:104: 00000100:00100000:2.0:1789683628.651285:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683628.651285:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b88a7d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a7d9 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683628.651330:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683628.651335:0:17183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7999f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+3:18355:x1876618850255872:12345-0@lo:104: Request processed in 65us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683628.651342:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789683628.651387:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850256000 00000100:00100000:3.0:1789683628.651392:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850256000 00010000:00010000:3.0:1789683628.651413:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f8454d800/0xcf8485587b88a8dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a8d5 expref: 18 pid: 17194 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683628.651454:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789683628.651461:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:3647:x1876618850256000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683628.651472:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683628.651477:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f8454d800/0xcf8485587b88a8dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a8d5 expref: 18 pid: 17194 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683628.651487:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f8454d800/0xcf8485587b88a8dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88a8d5 expref: 18 pid: 17194 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683628.651501:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683628.651528:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:3647:x1876618850256000:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683628.651533:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683628.651673:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850256000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683628.654678:0:18355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c280840 going to sleep for 11 seconds 00010000:00010000:0.0:1789683628.654724:0:18355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f8454d800/0xcf8485587b88a8dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88a8d5 expref: 17 pid: 17194 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683628.654741:0:18355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18355:1876618850255744:0@lo:104: 00000100:00100000:0.0:1789683628.654753:0:18355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18355:1876618850255872:0@lo:104: 00010000:00010000:0.0:1789683628.654779:0:18355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a930 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683628.654904:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683628.654912:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b88a7d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a7d9 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683628.654920:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9200 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683628.654924:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b88a7d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88a7d9 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683628.654934:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b88a7d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88a7d9 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683628.654941:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b88a7d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88a7d9 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683628.654947:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789683628.655011:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b88a7d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a7d9 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683628.655018:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683628.655058:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b88a7d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a7d9 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683628.655066:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9200/0xcf8485587b88a7d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a7d9 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683628.655080:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683628.655082:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683628.655084:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683628.655092:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683628.655108:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850256128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683628.655171:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683628.655245:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850256128 00000100:00100000:2.0:1789683628.655251:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850256128 00010000:00010000:2.0:1789683628.655284:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0e837da600/0xcf8485587b88a7d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a7d2 expref: 17 pid: 17195 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683628.655536:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789683628.655548:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:3650:x1876618850256128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683628.655566:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683628.655572:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0e837da600/0xcf8485587b88a7d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a7d2 expref: 17 pid: 17195 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683628.655584:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0e837da600/0xcf8485587b88a7d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88a7d2 expref: 17 pid: 17195 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683628.655600:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837da600/0xcf8485587b88a7d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88a7d2 expref: 17 pid: 17195 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683628.655627:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a930 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683628.655635:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a930 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683628.655656:0:17185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a930 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683628.655663:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a930 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683628.655670:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a930 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683628.655677:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a930 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683628.655682:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dbc00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683628.655687:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a930 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683628.655695:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a930 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683628.655708:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a930 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683628.655718:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683628.655763:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+16:3650:x1876618850256128:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683628.655776:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789683628.655865:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850256128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683628.656158:0:18355:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a930 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683628.656181:0:18355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a930 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683628.656187:0:18355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837dbc00/0xcf8485587b88a930 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683629.600459:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683629.672430:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683629.672621:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683619/real 1789683619] req@ffff9f0fb7998e00 x1876618850251136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683629 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683629.672653:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fb7998e00 x1876618850251136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683629 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683629.672663:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683619/real 1789683619] req@ffff9f0fb7998700 x1876618850251008/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683629 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683629.672673:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fb7998700 x1876618850251008/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683629 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789683629.672687:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdbd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683629.672701:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789683629.672705:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850251136:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789683629.672711:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f8554b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683629.672715:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789683629.672718:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850251008:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1789683629.672813:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850256256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683629.672937:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789683629.673057:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683629.673061:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789683629.673064:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683629.673067:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789683629.673077:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683629.673081:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789683629.673083:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0f8554b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683629.673089:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 533 00000100:00080000:3.0:1789683629.673107:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789683629.673119:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f0f8554b800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683629.673143:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc0724700 x1876618850256896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683629.673156:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683629.673159:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789683629.673161:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdbd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683629.673164:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 533 00000100:00080000:3.0:1789683629.673166:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789683629.673170:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0f8bdbd000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683629.673181:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc0725f80 x1876618850257024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789683629.673215:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850256384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683629.673243:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683629.673265:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850257152:0@lo:400:kworker.0 00000100:00100000:3.0:1789683629.673288:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683629.674849:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850256256 00000100:00100000:2.0:1789683629.674861:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850256256 00000100:00100000:2.0:1789683629.674917:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850256384 00000100:00100000:2.0:1789683629.674920:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850256384 00000100:00100000:2.0:1789683629.674936:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789683629.674944:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850256256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683629.674980:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789683629.675049:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850256256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (2111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683629.675056:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789683629.675073:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789683629.675080:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876618850256384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789683629.675096:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789683629.675169:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876618850256384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683629.675175:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789683629.676421:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850257152 00000100:00100000:2.0:1789683629.676431:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850257152 00000100:00100000:2.0:1789683629.676488:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789683629.676498:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850257152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683629.676601:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850256384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683629.676620:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683629.676633:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850256512:0@lo:400:kworker.0 00000001:00100000:1.0:1789683629.677076:0:17933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789683629.678064:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850256896:0@lo:8:kworker.0 00000100:00100000:2.0:1789683629.678174:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850257152:12345-0@lo:400:kworker.0 Request processed in 1677us (4883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683629.678184:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683629.678318:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789683629.678376:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0e8451ed80 x1876618850257152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683629.678389:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850257152:0@lo:400:kworker.0 00000100:00100000:3.0:1789683629.678417:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850256640:0@lo:400:kworker.0 00000100:00100000:2.0:1789683629.678699:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850256512 00000100:00100000:2.0:1789683629.678705:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850256512 00000100:00100000:2.0:1789683629.678749:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789683629.678758:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc037bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+16:3647:x1876618850256512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683629.678856:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc037bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+16:3647:x1876618850256512:12345-0@lo:400:kworker.0 Request processed in 99us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683629.678863:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789683629.679000:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683629.679040:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850256256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683629.679058:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683629.679065:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850256768:0@lo:400:kworker.0 00000100:00100000:3.0:1789683629.679093:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683629.679119:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850256640 00000100:00100000:3.0:1789683629.679123:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850256640 00000100:00100000:3.0:1789683629.679152:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683629.679158:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850256640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683629.679197:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850256640:12345-0@lo:400:kworker.0 Request processed in 39us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683629.679203:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683629.679223:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850256768 00000100:00100000:3.0:1789683629.679227:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850256768 00000100:00100000:3.0:1789683629.679256:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683629.679263:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850256768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683629.679294:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850256768:12345-0@lo:400:kworker.0 Request processed in 32us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683629.679299:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683629.679325:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850256512:0@lo:400:kworker.0 00010000:00080000:3.0:1789683629.679354:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0fc0726680 x1876618850256768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683629.679363:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850256768:0@lo:400:kworker.0 00000100:00100000:3.0:1789683629.679374:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850256640:0@lo:400:kworker.0 00000400:00000100:2.0:1789683629.680432:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850256896 offset 0 length 520: 4 00000100:00100000:2.0:1789683629.680522:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850257024:0@lo:8:kworker.0 00000400:00000100:2.0:1789683629.680547:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850257024 offset 0 length 520: 4 10000000:01000000:3.0:1789683630.431391:0:17197:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789683630.431409:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0fc04cf800 from 13 10000000:01000000:3.0:1789683630.431416:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789683630.431474:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88a937 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683630.431489:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88a937 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683630.431503:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88a937 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683630.431541:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850257280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789683630.431624:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683630.431687:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb85c9600 going to sleep for 11 seconds 00000100:00100000:0.0:1789683630.432134:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850257280 00000100:00100000:0.0:1789683630.432143:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850257280 00000100:00100000:0.0:1789683630.432212:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789683630.432223:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+16:17197:x1876618850257280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683630.432241:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683630.432257:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454d400/0xcf8485587b88a93e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a937 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683630.432293:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454d400/0xcf8485587b88a93e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a937 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683630.432303:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454d400/0xcf8485587b88a93e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a937 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683630.432311:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d400, rc 0) 00000100:00100000:0.0:1789683630.432377:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17197:x1876618850257280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683630.432384:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789683630.432713:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850257280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683630.432729:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88a937 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a93e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683630.432738:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88a937 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a93e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683630.432847:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850257408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683630.432878:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683630.432908:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c280780 going to sleep for 11 seconds 00000100:00100000:3.0:1789683630.432964:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850257408 00000100:00100000:3.0:1789683630.432968:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850257408 00000100:00100000:3.0:1789683630.432991:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789683630.432997:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17197:x1876618850257408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683630.433112:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17197:x1876618850257408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683630.433119:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789683630.433235:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850257408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683630.433263:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850257536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683630.433318:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683630.433341:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c280780 going to sleep for 11 seconds 00000100:00100000:3.0:1789683630.433546:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850257536 00000100:00100000:3.0:1789683630.433552:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850257536 00000100:00100000:3.0:1789683630.433586:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789683630.433593:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc037a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17197:x1876618850257536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683630.433669:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc037a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17197:x1876618850257536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683630.433675:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789683630.433902:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850257536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789683630.437949:0:18423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789683630.438211:0:17197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789683630.438237:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789683630.438267:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88a937 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a93e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683630.438292:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88a937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a93e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683630.438305:0:17197:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789683630.438308:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0e83ec0800 from 13 10000000:01000000:0.0:1789683630.438310:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789683630.438364:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ce00/0xcf8485587b88a945 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683630.438373:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ce00/0xcf8485587b88a945 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683630.438385:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ce00/0xcf8485587b88a945 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683630.438410:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850257664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789683630.438480:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683630.438513:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683630.438892:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850257664 00000100:00100000:3.0:1789683630.438907:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850257664 00000100:00100000:3.0:1789683630.438963:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789683630.438973:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+17:17197:x1876618850257664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683630.438986:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683630.438999:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb6177200/0xcf8485587b88a94c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a945 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683630.439023:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb6177200/0xcf8485587b88a94c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a945 expref: 18 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683630.439034:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb6177200/0xcf8485587b88a94c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a945 expref: 18 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683630.439043:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6177200, rc 0) 00000100:00100000:3.0:1789683630.439086:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17197:x1876618850257664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683630.439092:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789683630.439591:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850257664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683630.439607:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ce00/0xcf8485587b88a945 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a94c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683630.439617:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ce00/0xcf8485587b88a945 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a94c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683630.439698:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850257792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683630.439741:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683630.439773:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683630.439860:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850257792 00000100:00100000:1.0:1789683630.439871:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850257792 00000100:00100000:1.0:1789683630.439905:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789683630.439912:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc037a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17197:x1876618850257792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683630.440067:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc037a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17197:x1876618850257792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683630.440075:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789683630.440616:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850257792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683630.440656:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850257920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683630.440720:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683630.440746:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683630.440807:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850257920 00000100:00100000:3.0:1789683630.440812:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850257920 00000100:00100000:3.0:1789683630.440852:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789683630.440858:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc037b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17197:x1876618850257920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683630.440938:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc037b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:17197:x1876618850257920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683630.440944:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789683630.441019:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850257920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789683630.442037:0:18424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789683630.442703:0:17197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789683630.442734:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789683630.442747:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ce00/0xcf8485587b88a945 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a94c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683630.442772:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ce00/0xcf8485587b88a945 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a94c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683630.631909:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683630.689272:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683615/real 1789683615] req@ffff9f0fc0727800 x1876618850248960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683630 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683630.689304:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fc0727800 x1876618850248960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683630 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683630.689315:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683615/real 1789683615] req@ffff9f0fc0725500 x1876618850249088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683630 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683630.689326:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fc0725500 x1876618850249088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683630 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789683630.689360:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83446000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683630.689373:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789683630.689378:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850248960:0@lo:8:kworker.0 00000100:00080000:3.0:1789683630.689383:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb240d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683630.689389:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789683630.689391:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850249088:0@lo:8:kworker.0 00000100:00080000:2.0:1789683630.693252:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683630.693258:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789683630.693262:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0e83446000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789683630.693270:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:2.0:1789683630.693276:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789683630.693296:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f0e83446000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683630.693319:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7246300 x1876618850258176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789683630.693342:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683630.693346:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789683630.693347:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0fb240d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789683630.693351:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:2.0:1789683630.693353:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789683630.693357:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0fb240d000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683630.693370:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7246a00 x1876618850258304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789683630.693397:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683630.693400:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789683630.693402:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1789683630.693404:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850258432:0@lo:400:kworker.0 00000100:00080000:2.0:1789683630.693405:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789683630.693425:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850258048:0@lo:400:kworker.0 00000100:00100000:2.0:1789683630.694694:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683630.694739:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683630.694761:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850258688:0@lo:400:kworker.0 00000100:00100000:2.0:1789683630.694819:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683630.694861:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850258176:0@lo:8:kworker.0 00000400:00000100:2.0:1789683630.694882:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850258176 offset 0 length 520: 4 00000100:00100000:2.0:1789683630.694907:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850258304:0@lo:8:kworker.0 00000400:00000100:2.0:1789683630.694924:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618850258304 offset 0 length 520: 4 00000100:00100000:2.0:1789683630.694950:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850258560:0@lo:400:kworker.0 00000100:00100000:2.0:1789683630.694973:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683630.695006:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850258048 00000100:00100000:2.0:1789683630.695014:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850258048 00000100:00100000:2.0:1789683630.695056:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850258560 00000100:00100000:2.0:1789683630.695059:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850258560 00000100:00100000:2.0:1789683630.695076:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789683630.695084:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850258048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683630.695138:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850258048:12345-0@lo:400:kworker.0 Request processed in 54us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683630.695146:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789683630.695161:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789683630.695166:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850258560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683630.695213:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850258560:12345-0@lo:400:kworker.0 Request processed in 46us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683630.695219:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789683630.695236:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850258688 00000100:00100000:2.0:1789683630.695240:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850258688 00000100:00100000:2.0:1789683630.695264:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789683630.695270:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850258688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683630.695305:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876618850258688:12345-0@lo:400:kworker.0 Request processed in 35us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683630.695311:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789683630.697037:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850258560:0@lo:400:kworker.0 00010000:00080000:2.0:1789683630.697100:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0fa7244000 x1876618850258688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683630.697111:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876618850258688:0@lo:400:kworker.0 00000100:00100000:2.0:1789683630.697122:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850258048:0@lo:400:kworker.0 00000100:00100000:0.0:1789683630.702521:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683630.705226:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850258432 00000100:00100000:0.0:1789683630.705239:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850258432 00000100:00100000:0.0:1789683630.705975:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789683630.705990:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850258432:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789683630.706139:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0fa7245180 x1876618850258432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683630.706156:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850258432:0@lo:400:kworker.0 00000100:00100000:0.0:1789683630.707028:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850258432:12345-0@lo:400:kworker.0 Request processed in 1040us (4512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683630.707039:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:00080000:2.0:1789683631.391651:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789683631.647024:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683632.671505:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683633.701211:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683634.722450:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683634.789268:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850258816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683634.789385:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683634.789454:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850258816 00000100:00100000:3.0:1789683634.789462:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850258816 00000100:00100000:3.0:1789683634.789503:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789683634.789522:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850258816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789683634.789558:0:17941:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789683634.789606:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850258816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683634.789613:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789683634.789663:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850258816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683634.791988:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683634.792006:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850258944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683634.792065:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683634.792142:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850258944 00000100:00100000:0.0:1789683634.792148:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850258944 00000100:00100000:0.0:1789683634.792189:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789683634.792196:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850258944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789683634.792236:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789683634.792292:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850258944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683634.792299:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789683634.792339:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850258944:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789683635.743970:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789683635.808619:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683635.808626:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683635.808629:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683635.808632:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683635.808648:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683635.808651:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683635.808654:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683635.808657:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789683635.808688:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850259200:0@lo:400:kworker.0 00000100:00100000:1.0:1789683635.808769:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683635.808842:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683635.808849:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850259328:0@lo:400:kworker.0 00000100:00100000:1.0:1789683635.808876:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683635.808926:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850259200 00000100:00100000:1.0:1789683635.808935:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850259200 00000100:00100000:1.0:1789683635.808977:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789683635.808986:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850259200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683635.809063:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850259200:12345-0@lo:400:kworker.0 Request processed in 77us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683635.809084:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789683635.809112:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850259328 00000100:00100000:1.0:1789683635.809116:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850259328 00000100:00100000:1.0:1789683635.809145:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789683635.809152:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850259328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683635.809375:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850259328:12345-0@lo:400:kworker.0 Request processed in 223us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683635.809383:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789683635.809433:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0fb799b100 x1876618850259328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683635.809454:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850259328:0@lo:400:kworker.0 00000100:00100000:1.0:1789683635.809467:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850259200:0@lo:400:kworker.0 00000100:00100000:0.0:1789683635.809856:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850259072:0@lo:400:kworker.0 00000100:00100000:0.0:1789683635.809906:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683635.809940:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850259584:0@lo:400:kworker.0 00000100:00100000:0.0:1789683635.809964:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683635.809982:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683635.809988:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850259456:0@lo:400:kworker.0 00000100:00100000:0.0:1789683635.810134:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683635.810171:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850259456 00000100:00100000:0.0:1789683635.810177:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850259456 00000100:00100000:0.0:1789683635.810223:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789683635.810230:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850259456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683635.810271:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850259456:12345-0@lo:400:kworker.0 Request processed in 42us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683635.810278:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789683635.810296:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850259584 00000100:00100000:0.0:1789683635.810300:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850259584 00000100:00100000:0.0:1789683635.810321:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789683635.810327:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850259584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683635.810356:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850259584:12345-0@lo:400:kworker.0 Request processed in 29us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683635.810375:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789683635.810411:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850259456:0@lo:400:kworker.0 00010000:00080000:0.0:1789683635.810422:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0fb799aa00 x1876618850259584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683635.810431:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850259584:0@lo:400:kworker.0 00000100:00100000:1.0:1789683635.811409:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850259072 00000100:00100000:1.0:1789683635.811416:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850259072 00000100:00100000:1.0:1789683635.811460:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789683635.811468:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:3650:x1876618850259072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683635.811520:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:3650:x1876618850259072:12345-0@lo:400:kworker.0 Request processed in 53us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683635.811526:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789683635.811908:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850259072:0@lo:400:kworker.0 00000020:01000004:2.0:1789683636.163148:0:18703:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789683636.163152:0:18703:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789683636.163154:0:18703:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789683636.163386:0:18703:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0fc06b1000 00000020:01000004:2.0:1789683636.163406:0:18703:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789683636.163426:0:18703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789683636.163443:0:18703:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9f0fc1243380) 00000020:00000080:2.0:1789683636.163461:0:18703:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789683636.213348:0:18703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789683636.214297:0:18703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789683636.214768:0:18703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789683636.215216:0:18703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789683636.215460:0:18703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789683636.215680:0:18703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789683636.216162:0:18703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:0.0:1789683636.219979:0:18703:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789683636.220249:0:18703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789683636.220264:0:18703:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789683636.220278:0:18703:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf8485587b88a95a 00000020:01000004:0.0:1789683636.220286:0:18703:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789683636.220310:0:18703:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.150@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789683636.220314:0:18703:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789683636.220320:0:18703:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789683636.220325:0:18703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789683636.220337:0:18703:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9f0fa71999c0) 00000020:00000080:0.0:1789683636.220349:0:18703:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1789683636.223019:0:18703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683636.223312:0:18703:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789683636.223319:0:18703:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789683636.228093:0:18703:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789683636.228109:0:18703:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789683636.229269:0:18703:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789683636.229276:0:18703:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789683636.231097:0:18703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789683636.231387:0:18703:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789683636.231401:0:18703:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789683636.234497:0:18703:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789683636.234508:0:18703:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000040:00080000:2.0:1789683636.255544:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789683636.259230:0:18703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683636.259639:0:18703:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789683636.259648:0:18703:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789683636.261144:0:18703:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789683636.261160:0:18703:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789683636.262372:0:18703:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789683636.262383:0:18703:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789683636.265075:0:18703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683636.265273:0:18703:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789683636.265279:0:18703:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789683636.266118:0:18703:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789683636.266127:0:18703:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789683636.304353:0:18703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683636.304588:0:18703:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789683636.304595:0:18703:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789683636.306601:0:18703:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789683636.306616:0:18703:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789683636.307418:0:18703:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789683636.307447:0:18703:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1789683636.307453:0:18703:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789683636.320036:0:18703:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789683636.320082:0:18703:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.150@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789683636.320087:0:18703:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789683636.320089:0:18703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789683636.320090:0:18703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789683636.320091:0:18703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789683636.320093:0:18703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789683636.320094:0:18703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789683636.320095:0:18703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789683636.320097:0:18703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789683636.320098:0:18703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789683636.320102:0:18703:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789683636.320104:0:18703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789683636.320105:0:18703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789683636.320106:0:18703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789683636.320107:0:18703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789683636.320108:0:18703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789683636.320109:0:18703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789683636.320110:0:18703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789683636.320111:0:18703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789683636.320112:0:18703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789683636.320364:0:18703:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789683636.320389:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850259712:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789683636.320482:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683636.320590:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f90530600 going to sleep for 11 seconds 00000100:00100000:3.0:1789683636.320678:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850259712 00000100:00100000:3.0:1789683636.320687:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850259712 00000100:00100000:3.0:1789683636.320810:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789683636.320821:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:18703:x1876618850259712:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789683636.320854:0:17193:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789683636.320858:0:17193:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789683636.320861:0:17193:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789683636.321395:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:18703:x1876618850259712:12345-0@lo:253:mount.lustre.0 Request processed in 575us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683636.321405:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789683636.321577:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850259712:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789683636.321590:0:18703:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789683636.321594:0:18703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789683636.321596:0:18703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789683636.321597:0:18703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683636.321598:0:18703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683636.321599:0:18703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683636.321601:0:18703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683636.321603:0:18703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683636.321605:0:18703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683636.321607:0:18703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789683636.321635:0:18703:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0fc06b1000 from lustre-OST0000 10000000:01000000:0.0:1789683636.321682:0:18703:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789683636.321685:0:18703:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789683636.321695:0:18703:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f0fb504b380 local copy 00010000:00010000:0.0:1789683636.321720:0:18703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a71c expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683636.321876:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850259840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683636.321921:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683636.322185:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e92600 going to sleep for 11 seconds 00000100:00100000:1.0:1789683636.322329:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850259840 00000100:00100000:1.0:1789683636.322337:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850259840 00000100:00100000:1.0:1789683636.322379:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789683636.322386:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:18703:x1876618850259840:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683636.322485:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:18703:x1876618850259840:12345-0@lo:501:mount.lustre.0 Request processed in 98us (563us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789683636.322491:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789683636.322566:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850259840:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789683636.322584:0:18703:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789683636.322604:0:18703:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789683636.322611:0:18703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a71c expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683636.322621:0:18703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a71c expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683636.322661:0:18703:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0fc06b1000 10000000:01000000:0.0:1789683636.322666:0:18703:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789683636.322671:0:18703:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789683636.322673:0:18703:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789683636.322677:0:18703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789683636.322680:0:18703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789683636.322703:0:18703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c800/0xcf8485587b88a968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683636.322721:0:18703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c800/0xcf8485587b88a968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683636.322729:0:18703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c800/0xcf8485587b88a968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683636.322743:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850259968:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789683636.322773:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683636.322914:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850259968 00000100:00100000:1.0:1789683636.322919:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850259968 00000100:00100000:1.0:1789683636.322937:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789683636.322943:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+18:18703:x1876618850259968:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683636.322953:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683636.322968:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837dac00/0xcf8485587b88a96f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a968 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683636.322995:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837dac00/0xcf8485587b88a96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a968 expref: 19 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683636.323007:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837dac00/0xcf8485587b88a96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a968 expref: 19 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683636.323015:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dac00, rc 0) 00000100:00100000:3.0:1789683636.323327:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+19:18703:x1876618850259968:12345-0@lo:101:mount.lustre.0 Request processed in 382us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683636.323334:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789683636.323430:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e92600 going to sleep for 11 seconds 00000100:00100000:0.0:1789683636.323446:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850259968:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683636.323461:0:18703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c800/0xcf8485587b88a968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a96f expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683636.323471:0:18703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c800/0xcf8485587b88a968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a96f expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789683636.324657:0:18703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789683636.325396:0:18703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683636.331149:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789683636.331238:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789683636.331256:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789683636.331270:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789683636.331285:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789683636.331300:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789683636.331325:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789683636.331331:0:18703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789683636.331435:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850260096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683636.331503:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683636.331607:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb85c9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683636.331974:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850260096 00000100:00100000:3.0:1789683636.331983:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850260096 00000100:00100000:3.0:1789683636.332115:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789683636.332126:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+19:18703:x1876618850260096:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683636.332304:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+19:18703:x1876618850260096:12345-0@lo:501:mount.lustre.0 Request processed in 180us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683636.332312:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789683636.332397:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850260096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683636.332440:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850260224:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683636.332487:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683636.332626:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f90530780 going to sleep for 11 seconds 00000100:00100000:0.0:1789683636.332692:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850260224 00000100:00100000:0.0:1789683636.332697:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850260224 00000100:00100000:0.0:1789683636.332729:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789683636.332737:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+19:18703:x1876618850260224:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683636.333735:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+19:18703:x1876618850260224:12345-0@lo:503:mount.lustre.0 Request processed in 993us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683636.333746:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789683636.333972:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850260224:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789683636.334537:0:18703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789683636.334642:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850260352:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683636.334693:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683636.334745:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e92600 going to sleep for 11 seconds 00000100:00100000:2.0:1789683636.334837:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850260352 00000100:00100000:2.0:1789683636.334846:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850260352 00000100:00100000:2.0:1789683636.334897:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789683636.334909:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+19:18703:x1876618850260352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683636.335378:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+19:18703:x1876618850260352:12345-0@lo:502:mount.lustre.0 Request processed in 471us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683636.335386:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789683636.335509:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850260352:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789683636.335759:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789683636.335939:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789683636.335959:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789683636.335972:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789683636.335985:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789683636.335998:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789683636.336011:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789683636.336023:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789683636.336037:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789683636.336048:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789683636.336059:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789683636.336071:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789683636.336115:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850260480:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683636.336158:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683636.336280:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850260480 00000100:00100000:2.0:1789683636.336286:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850260480 00000100:00100000:2.0:1789683636.336328:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789683636.336336:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+19:18703:x1876618850260480:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683636.336486:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683636.337443:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+19:18703:x1876618850260480:12345-0@lo:502:mount.lustre.0 Request processed in 1102us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683636.337456:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789683636.337552:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850260480:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789683636.337652:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1789683636.337666:0:18703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1789683636.338677:0:18720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789683636.338688:0:18720:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789683636.338695:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683636.338698:0:18720:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789683636.338721:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789683636.338739:0:18720:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9f0fa508cd40) 00000020:00000080:3.0:1789683636.338763:0:18720:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789683636.338769:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789683636.339088:0:18720:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0fc06b1000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789683636.339098:0:18720:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789683636.339105:0:18720:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf8485587b88a97d 00010000:00010000:3.0:1789683636.347144:0:18720:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1789683636.347751:0:18720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:3.0:1789683636.349567:0:18720:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1789683636.350851:0:18720:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789683636.350863:0:18720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683636.350870:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683636.350872:0:18720:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789683636.350876:0:18720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789683636.350879:0:18720:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1789683636.350880:0:18720:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789683636.350882:0:18720:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789683636.350883:0:18720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789683636.350886:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683636.350887:0:18720:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789683636.350889:0:18720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683636.350892:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683636.350894:0:18720:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789683636.350896:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789683636.350899:0:18720:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789683636.350901:0:18720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683636.350903:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683636.350904:0:18720:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789683636.350906:0:18720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683636.350909:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683636.350910:0:18720:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789683636.350913:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789683636.350938:0:18720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683636.350948:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683636.350949:0:18720:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789683636.350952:0:18720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789683636.351249:0:18703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789683636.351287:0:18703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789683636.351311:0:18703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c800/0xcf8485587b88a968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a96f expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683636.351323:0:18703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c800/0xcf8485587b88a968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a96f expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683636.351331:0:18703:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0fc06b1000 from 1 10000000:01000000:1.0:1789683636.351334:0:18703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789683636.351381:0:18703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88a984 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683636.351388:0:18703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88a984 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683636.351400:0:18703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88a984 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683636.351428:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850260608:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789683636.351497:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683636.351549:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f90530000 going to sleep for 11 seconds 00000100:00100000:2.0:1789683636.351628:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850260608 00000100:00100000:2.0:1789683636.351636:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850260608 00000100:00100000:2.0:1789683636.351697:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789683636.351707:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+19:18703:x1876618850260608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683636.351731:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683636.351744:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f8800/0xcf8485587b88a98b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a984 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683636.351768:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f8800/0xcf8485587b88a98b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a984 expref: 20 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683636.351779:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f8800/0xcf8485587b88a98b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a984 expref: 20 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683636.351811:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f8800, rc 0) 00000100:00100000:2.0:1789683636.351860:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+20:18703:x1876618850260608:12345-0@lo:101:mount.lustre.0 Request processed in 154us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683636.351866:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789683636.352006:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850260608:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683636.352021:0:18703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88a984 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a98b expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683636.352030:0:18703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88a984 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a98b expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789683636.353778:0:18703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789683636.354137:0:18703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683636.354977:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789683636.355006:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789683636.355025:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789683636.355030:0:18703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789683636.355113:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850260736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683636.355190:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683636.355228:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f905309c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683636.355323:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850260736 00000100:00100000:3.0:1789683636.355331:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850260736 00000100:00100000:3.0:1789683636.355382:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789683636.355392:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+20:18703:x1876618850260736:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683636.355497:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+20:18703:x1876618850260736:12345-0@lo:501:mount.lustre.0 Request processed in 107us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683636.355504:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789683636.357373:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850260736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683636.357435:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850260864:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683636.357503:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683636.357545:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f905309c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683636.361322:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850260864 00000100:00100000:0.0:1789683636.361337:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850260864 00000100:00100000:0.0:1789683636.361437:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789683636.361449:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+20:18703:x1876618850260864:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683636.361638:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+20:18703:x1876618850260864:12345-0@lo:503:mount.lustre.0 Request processed in 192us (4134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683636.361646:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789683636.361818:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850260864:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789683636.362292:0:18703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789683636.362372:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850260992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683636.362425:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683636.372037:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850260992 00000100:00100000:0.0:1789683636.372075:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850260992 00000100:00100000:0.0:1789683636.372143:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789683636.372154:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+20:18703:x1876618850260992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683636.372318:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+20:18703:x1876618850260992:12345-0@lo:502:mount.lustre.0 Request processed in 166us (9893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683636.372326:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789683636.372418:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f90530000 going to sleep for 11 seconds 00000100:00100000:1.0:1789683636.372442:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850260992:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789683636.377224:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789683636.377288:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789683636.377302:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789683636.377316:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789683636.378088:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789683636.378115:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789683636.378144:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789683636.378158:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1789683636.378170:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789683636.378183:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1789683636.378197:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1789683636.378251:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850261120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683636.378335:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683636.378431:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f90530000 going to sleep for 11 seconds 00000100:00100000:0.0:1789683636.378495:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850261120 00000100:00100000:0.0:1789683636.378503:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850261120 00000100:00100000:0.0:1789683636.378557:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789683636.378567:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+20:18703:x1876618850261120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683636.379042:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+20:18703:x1876618850261120:12345-0@lo:502:mount.lustre.0 Request processed in 475us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683636.379051:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789683636.379142:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850261120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789683636.379198:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1789683636.379208:0:18703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789683636.380112:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683636.380122:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683636.380125:0:18724:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789683636.380132:0:18724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0fc06b1000 00000020:00000080:1.0:1789683636.380134:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789683636.380142:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683636.380144:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683636.380145:0:18724:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789683636.380147:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683636.380149:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683636.380151:0:18724:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789683636.380154:0:18724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0fc06b1000 00000020:00000080:1.0:1789683636.380156:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789683636.380253:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683636.380257:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683636.380259:0:18724:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789683636.380261:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683636.380263:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683636.380264:0:18724:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789683636.380268:0:18724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0fc06b1000 00000020:00000080:1.0:1789683636.380276:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789683636.388123:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683636.403767:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683636.403775:0:18724:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789683636.404060:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683636.404069:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683636.404071:0:18724:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789683636.404078:0:18724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0fc06b1000 00000020:00000080:2.0:1789683636.404080:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789683636.404200:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683636.404204:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683636.404206:0:18724:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789683636.404209:0:18724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789683636.404288:0:18703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789683636.404315:0:18703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683636.404332:0:18703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88a984 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a98b expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683636.404345:0:18703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88a984 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a98b expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683636.404402:0:18703:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789683636.404410:0:18703:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0fc06b1000 10000000:01000000:2.0:1789683636.404413:0:18703:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0fc06b1000 10000000:01000000:2.0:1789683636.404418:0:18703:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789683636.404425:0:18703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0fc06b1000 from 1 10000000:01000000:2.0:1789683636.404427:0:18703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789683636.404467:0:18703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88a992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683636.404487:0:18703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88a992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683636.404500:0:18703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88a992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683636.404527:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850261248:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789683636.404610:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683636.404660:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89dd2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683636.404684:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850261248 00000100:00100000:2.0:1789683636.404691:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850261248 00000100:00100000:2.0:1789683636.404747:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789683636.404757:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+20:18703:x1876618850261248:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683636.404773:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683636.404804:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f9400/0xcf8485587b88a999 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a992 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683636.404830:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f9400/0xcf8485587b88a999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a992 expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683636.404840:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f9400/0xcf8485587b88a999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a992 expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683636.404849:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f9400, rc 0) 00000100:00100000:2.0:1789683636.404892:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:18703:x1876618850261248:12345-0@lo:101:mount.lustre.0 Request processed in 137us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683636.404899:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789683636.404955:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850261248:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683636.404969:0:18703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88a992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a999 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683636.404978:0:18703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88a992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a999 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789683636.413296:0:18703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1789683636.413589:0:18703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789683636.414050:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789683636.414091:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789683636.414103:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789683636.414116:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789683636.414128:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789683636.414139:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789683636.414151:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789683636.414163:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789683636.414188:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789683636.414203:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789683636.414215:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789683636.414226:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789683636.414238:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789683636.414250:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789683636.414261:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789683636.414574:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789683636.414591:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789683636.414603:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789683636.414616:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789683636.414628:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789683636.414638:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789683636.414650:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789683636.414661:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789683636.414687:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789683636.414701:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1789683636.414727:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1789683636.414743:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1789683636.414755:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1789683636.414768:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1789683636.414779:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1789683636.414828:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1789683636.414860:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1789683636.414874:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1789683636.414886:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1789683636.414897:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1789683636.414910:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1789683636.414922:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1789683636.414942:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1789683636.414947:0:18703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1789683636.415042:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850261376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683636.415112:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683636.415158:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89dd2000 going to sleep for 11 seconds 00000100:00100000:1.0:1789683636.415588:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850261376 00000100:00100000:1.0:1789683636.415595:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850261376 00000100:00100000:1.0:1789683636.415648:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789683636.415659:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7958450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:18703:x1876618850261376:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683636.415831:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7958450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:18703:x1876618850261376:12345-0@lo:501:mount.lustre.0 Request processed in 173us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683636.415840:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789683636.415956:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850261376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683636.415994:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850261504:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789683636.416038:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683636.416068:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89dd2000 going to sleep for 11 seconds 00000100:00100000:3.0:1789683636.416361:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850261504 00000100:00100000:3.0:1789683636.416366:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850261504 00000100:00100000:3.0:1789683636.416392:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789683636.416399:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7959850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:18703:x1876618850261504:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789683636.416485:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7959850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:18703:x1876618850261504:12345-0@lo:503:mount.lustre.0 Request processed in 85us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683636.416491:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789683636.426561:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850261504:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789683636.429986:0:18703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789683636.430089:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850261632:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683636.430257:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683636.430302:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83c83180 going to sleep for 11 seconds 00000100:00100000:2.0:1789683636.431639:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850261632 00000100:00100000:2.0:1789683636.431651:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850261632 00000100:00100000:2.0:1789683636.431986:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789683636.431999:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7959450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:18703:x1876618850261632:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683636.432395:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7959450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:18703:x1876618850261632:12345-0@lo:502:mount.lustre.0 Request processed in 394us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683636.432419:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789683636.433070:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850261632:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789683636.433880:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789683636.433937:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789683636.433961:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789683636.433978:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789683636.434011:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789683636.434023:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789683636.434034:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789683636.434044:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789683636.434071:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789683636.434088:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789683636.434101:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789683636.434111:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789683636.434121:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789683636.434131:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789683636.434142:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789683636.434153:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789683636.434163:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789683636.434629:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789683636.434650:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789683636.434664:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789683636.435018:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789683636.435042:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789683636.435056:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789683636.435070:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789683636.435083:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1789683636.435095:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1789683636.435108:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1789683636.435121:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1789683636.435135:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1789683636.435147:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1789683636.435160:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1789683636.435172:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1789683636.435187:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1789683636.435221:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1789683636.435237:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1789683636.435252:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1789683636.435266:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1789683636.435279:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1789683636.435293:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1789683636.435306:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1789683636.435319:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1789683636.435330:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1789683636.435342:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1789683636.435354:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1789683636.435373:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1789683636.435391:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1789683636.435403:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1789683636.435417:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1789683636.435482:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850261760:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683636.435560:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683636.435616:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e92d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683636.435994:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850261760 00000100:00100000:1.0:1789683636.436003:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850261760 00000100:00100000:1.0:1789683636.436062:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789683636.436072:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7958c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:18703:x1876618850261760:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683636.436324:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7958c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:18703:x1876618850261760:12345-0@lo:502:mount.lustre.0 Request processed in 253us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683636.436332:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789683636.436437:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850261760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789683636.436645:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1789683636.436669:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1789683636.436694:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850261888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683636.437207:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683636.437237:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e92d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683636.437761:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850261888 00000100:00100000:0.0:1789683636.437773:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850261888 00000100:00100000:0.0:1789683636.437981:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789683636.437990:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:18703:x1876618850261888:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683636.439328:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:18703:x1876618850261888:12345-0@lo:502:mount.lustre.0 Request processed in 1333us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683636.439339:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789683636.439395:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850261888:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789683636.439486:0:18703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1789683636.439499:0:18703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789683636.444012:0:18730:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789683636.444029:0:18730:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9f0fa5088000) 00000020:00000080:3.0:1789683636.444060:0:18730:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1789683636.444335:0:18730:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0fc06b1000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789683636.444340:0:18730:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0fc06b1000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789683636.444343:0:18730:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0fc06b1000 3 00010000:00080000:3.0:1789683636.444376:0:18730:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0e82d53000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.150@tcp at head 00010000:00010000:3.0:1789683636.446667:0:18730:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1789683636.446926:0:18730:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789683636.446973:0:18730:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789683636.446985:0:18730:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcf8485587b88a9a7 00000100:00080000:3.0:1789683636.446995:0:18730:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683636.447006:0:18730:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f0e82d53000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683636.447042:0:18730:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e8451e300 x1876618850262016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789683636.447119:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1876618850262016:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789683636.447199:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789683636.448886:0:18730:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:3.0:1789683636.449091:0:18730:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789683636.449113:0:18730:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9f0fc04d8000) 00000020:00000080:3.0:1789683636.449137:0:18730:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1789683636.449224:0:18730:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0fc06b1000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789683636.449229:0:18730:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0fc06b1000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789683636.449232:0:18730:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0fc06b1000 3 00010000:00080000:3.0:1789683636.449260:0:18730:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0e82d56800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.150@tcp at head 00000100:00080000:0.0:1789683636.449913:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789683636.449919:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789683636.449922:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789683636.449925:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789683636.449948:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789683636.449951:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789683636.449954:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789683636.449957:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789683636.450003:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850262144:0@lo:400:kworker.0 00000100:00100000:0.0:1789683636.450071:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683636.450105:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683636.450111:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850262272:0@lo:400:kworker.0 00000100:00100000:0.0:1789683636.450137:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683636.450469:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850262016 00000100:00100000:1.0:1789683636.450480:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850262016 00000100:00100000:1.0:1789683636.450515:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850262272 00000100:00100000:1.0:1789683636.450518:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850262272 00000100:00100000:1.0:1789683636.450543:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789683636.450552:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850262272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683636.450613:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850262272:12345-0@lo:400:kworker.0 Request processed in 62us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683636.450620:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789683636.450639:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683636.450643:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1876618850262016:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789683636.450663:0:17201:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:1.0:1789683636.450703:0:17201:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcf8485587b88a9b5 00000004:00100000:1.0:1789683636.450732:0:17201:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789683636.450770:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9f0f86d8a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683636.450868:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850262400:0@lo:400:kworker.0 00000100:00100000:0.0:1789683636.450899:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683636.450922:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683636.450928:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0f88c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850262528:0@lo:400:kworker.0 00000100:00100000:0.0:1789683636.450952:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683636.450985:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850262144 00000100:00100000:0.0:1789683636.450990:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850262144 00000100:00100000:0.0:1789683636.451017:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850262400 00000100:00100000:0.0:1789683636.451019:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850262400 00000100:00100000:0.0:1789683636.451034:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789683636.451040:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850262144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683636.451075:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850262144:12345-0@lo:400:kworker.0 Request processed in 36us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683636.451081:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789683636.451094:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789683636.451100:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850262400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683636.451130:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850262400:12345-0@lo:400:kworker.0 Request processed in 31us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683636.451136:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789683636.451154:0:17202:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789683636.451161:0:17202:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789683636.451257:0:17200:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789683636.451271:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850262528 00000100:00100000:0.0:1789683636.451275:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850262528 00000100:00100000:0.0:1789683636.451290:0:17200:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789683636.451296:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789683636.451301:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850262528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683636.451334:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850262528:12345-0@lo:400:kworker.0 Request processed in 30us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683636.451339:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789683636.451386:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0f88c76d80 x1876618850262272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683636.451401:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850262272:0@lo:400:kworker.0 00000100:00100000:0.0:1789683636.451412:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850262144:0@lo:400:kworker.0 00010000:00080000:0.0:1789683636.451442:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0f88c74700 x1876618850262528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683636.451449:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850262528:0@lo:400:kworker.0 00000100:00100000:0.0:1789683636.451457:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0f88c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850262400:0@lo:400:kworker.0 00010000:00010000:3.0:1789683636.456156:0:18730:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1789683636.456363:0:18730:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789683636.456409:0:18730:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789683636.456421:0:18730:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xcf8485587b88a9bc 00000100:00080000:3.0:1789683636.456432:0:18730:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683636.456445:0:18730:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9f0e82d56800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683636.456481:0:18730:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e8451c380 x1876618850262656/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789683636.457512:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1876618850262656:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789683636.457583:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683636.457698:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876618850262016:12345-0@lo:38:llog_process_th.0 Request processed in 7051us (10497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683636.457724:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683636.457750:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850262656 00000100:00100000:1.0:1789683636.457758:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850262656 00000100:00100000:1.0:1789683636.457780:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789683636.457801:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1876618850262656:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789683636.457834:0:17201:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:1.0:1789683636.457889:0:17201:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xcf8485587b88a9c3 00000004:00100000:1.0:1789683636.457909:0:17201:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789683636.457950:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9f0f86d88800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683636.457998:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876618850262656:12345-0@lo:38:llog_process_th.0 Request processed in 196us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683636.458004:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789683636.458284:0:18730:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789683636.460219:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683636.460229:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683636.460233:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683636.460236:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683636.460239:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683636.460242:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683636.460245:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683636.460254:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1789683636.461376:0:18730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1789683636.463806:0:18703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789683636.463857:0:18703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789683636.463879:0:18703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88a992 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a999 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683636.463893:0:18703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8000/0xcf8485587b88a992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a999 expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789683636.463951:0:18703:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789683636.463954:0:18703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789683636.463960:0:18703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683636.463961:0:18703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683636.463962:0:18703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683636.463963:0:18703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683636.463965:0:18703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683636.463967:0:18703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683636.463969:0:18703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789683636.463973:0:18703:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789683636.463975:0:18703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789683636.463976:0:18703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789683636.463977:0:18703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683636.463978:0:18703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683636.463979:0:18703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683636.463980:0:18703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683636.463981:0:18703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683636.463982:0:18703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683636.463982:0:18703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789683636.464014:0:18703:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789683636.464037:0:18703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850262784:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789683636.464359:0:18703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683636.464393:0:18703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f853949c0 going to sleep for 11 seconds 00010000:00080000:2.0:1789683636.464892:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0e8451e300 x1876618850262016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683636.464905:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789683636.464913:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789683636.464922:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789683636.464926:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789683636.464930:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e82d53000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789683636.464936:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1876618850262016:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789683636.464969:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0e8451c380 x1876618850262656/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683636.464977:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789683636.464981:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789683636.464985:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789683636.464988:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789683636.464990:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e82d56800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789683636.464994:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1876618850262656:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789683636.465086:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850262784 00000100:00100000:1.0:1789683636.465105:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850262784 00000100:00100000:1.0:1789683636.465161:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789683636.465301:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:18703:x1876618850262784:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789683636.465331:0:17195:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789683636.465345:0:17195:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789683636.471605:0:17195:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789683636.471622:0:17195:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789683636.471939:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:18703:x1876618850262784:12345-0@lo:253:mount.lustre.0 Request processed in 6763us (7574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683636.471951:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 20000000:01000000:2.0:1789683636.472041:0:17216:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789683636.472046:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789683636.472067:0:17216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88a9ca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683636.472093:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88a914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a90d expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683636.472101:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f8454da00/0xcf8485587b88a922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a91b expref: 20 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683636.472109:0:17216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88a9ca lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683636.472147:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f8454da00/0xcf8485587b88a922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88a91b expref: 20 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683636.472161:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0f8454da00/0xcf8485587b88a922 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88a91b expref: 20 pid: 17195 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683636.472239:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eac380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1876618850262912:0@lo:104: 00000100:00100000:2.0:1789683636.472275:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789683636.472320:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88a914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88a90d expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683636.472329:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88a914 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88a90d expref: 20 pid: 17194 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683636.472338:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83ead880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1876618850263040:0@lo:104: 00000100:00100000:2.0:1789683636.472359:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683636.472374:0:17216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89dd2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683636.472555:0:18703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:18703:1876618850262784:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789683636.472567:0:18703:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789683636.472577:0:18703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789683636.472578:0:18703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789683636.472580:0:18703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683636.472582:0:18703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683636.472583:0:18703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683636.472585:0:18703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683636.472587:0:18703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683636.472589:0:18703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683636.472590:0:18703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789683636.472605:0:18703:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789683636.473281:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789683636.473302:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850262912 00000100:00100000:1.0:1789683636.473309:0:17183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850262912 00000100:00100000:1.0:1789683636.473347:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850263040 00000100:00100000:1.0:1789683636.473350:0:17183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850263040 00000100:00100000:1.0:1789683636.473366:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683636.473375:0:17183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+4:17216:x1876618850262912:12345-0@lo:104: 00010000:00010000:1.0:1789683636.473391:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a91b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a922 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683636.473481:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683636.473488:0:17183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+4:17216:x1876618850262912:12345-0@lo:104: Request processed in 114us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683636.473496:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683636.473511:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683636.473517:0:17183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a5c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+3:17216:x1876618850263040:12345-0@lo:104: 00010000:00010000:1.0:1789683636.473530:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b88a90d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a914 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683636.473562:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789683636.473568:0:17183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a5c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+3:17216:x1876618850263040:12345-0@lo:104: Request processed in 51us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683636.473575:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683636.473665:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eac380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1876618850262912:0@lo:104: 00000100:00100000:3.0:1789683636.473675:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83ead880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1876618850263040:0@lo:104: 00010000:00010000:3.0:1789683636.473695:0:17216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88a9ca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.473725:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683636.473732:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a91b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a922 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.473739:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177400 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683636.473744:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a91b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88a922 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.473754:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a91b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88a922 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683636.473761:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a91b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88a922 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683636.473767:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683636.473848:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a91b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a922 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.473856:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683636.473878:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a91b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a922 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.473897:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a91b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a922 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.473910:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683636.473914:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b88a90d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a914 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.473919:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8e00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:3.0:1789683636.473922:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b88a90d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88a914 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.473929:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b88a90d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88a914 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683636.473935:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b88a90d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88a914 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683636.473940:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683636.473955:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b88a90d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a914 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.473960:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683636.473970:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b88a90d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a914 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.473976:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f8e00/0xcf8485587b88a90d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a914 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.473988:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683636.473995:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683636.473996:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683636.474012:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850263168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683636.474047:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683636.474081:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683636.474087:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850263296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683636.474110:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683636.474141:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850263168 00000100:00100000:3.0:1789683636.474146:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850263168 00010000:00010000:3.0:1789683636.474163:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f8454da00/0xcf8485587b88a922 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a91b expref: 21 pid: 17195 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683636.475309:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850263296 00000100:00100000:3.0:1789683636.475317:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850263296 00010000:00010000:3.0:1789683636.475341:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88a914 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a90d expref: 22 pid: 17194 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683636.475357:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683636.475364:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:3647:x1876618850263168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683636.475379:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683636.475385:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f8454da00/0xcf8485587b88a922 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a91b expref: 22 pid: 17195 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.475397:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f8454da00/0xcf8485587b88a922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88a91b expref: 22 pid: 17195 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.475414:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f8454da00/0xcf8485587b88a922 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88a91b expref: 22 pid: 17195 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.475429:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683636.475490:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:3647:x1876618850263168:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683636.475498:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683636.475514:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683636.475520:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8a3ad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+20:3647:x1876618850263296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683636.475528:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683636.475532:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88a914 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a90d expref: 20 pid: 17194 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.475542:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88a914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88a90d expref: 20 pid: 17194 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.475552:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88a914 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88a90d expref: 20 pid: 17194 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.475563:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88a9ca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.475572:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88a9ca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789683636.475587:0:17185:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009891571s 00010000:00010000:3.0:1789683636.475592:0:17185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88a9ca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.475600:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88a9ca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.475607:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88a9ca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.475625:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88a9ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.475631:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9000 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683636.475636:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88a9ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.475644:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88a9ca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.475659:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88a9ca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.475670:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683636.475696:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8a3ad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+19:3647:x1876618850263296:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683636.475703:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789683636.475856:0:17216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88a9ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.475865:0:17216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88a9ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683636.475871:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f9000/0xcf8485587b88a9ca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683636.475914:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850263296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683636.475923:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850263168:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683636.483862:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789683636.488604:0:18703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789683636.492457:0:18703:0:(ofd_obd.c:547:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789683636.492469:0:18703:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789683636.492512:0:18703:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789683636.492571:0:18703:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789683636.492596:0:18703:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789683636.492622:0:18703:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789683636.493606:0:18703:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789683636.493889:0:18703:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789683636.774621:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789683637.593501:0:18785:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789683637.594070:0:18785:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789683637.791610:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789683637.921817:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789683637.921826:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0fc04cf800 from 9 10000000:01000000:3.0:1789683637.921832:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789683637.921882:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176600/0xcf8485587b88a9d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683637.921895:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176600/0xcf8485587b88a9d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683637.921907:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176600/0xcf8485587b88a9d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683637.921934:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850263424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789683637.922020:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683637.922063:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c210d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683637.922363:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850263424 00000100:00100000:1.0:1789683637.922373:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850263424 00000100:00100000:1.0:1789683637.922430:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789683637.922439:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7959050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+19:17197:x1876618850263424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683637.922454:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683637.922468:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837db400/0xcf8485587b88a9d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a9d1 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683637.922493:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837db400/0xcf8485587b88a9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a9d1 expref: 20 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683637.922503:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837db400/0xcf8485587b88a9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a9d1 expref: 20 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683637.922513:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837db400, rc 0) 00000100:00100000:1.0:1789683637.922555:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7959050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+20:17197:x1876618850263424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683637.922562:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789683637.923128:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850263424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683637.923200:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176600/0xcf8485587b88a9d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a9d8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683637.923211:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176600/0xcf8485587b88a9d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a9d8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683637.923270:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850263552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789683637.923301:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683637.923324:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c210d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683637.923390:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850263552 00000100:00100000:1.0:1789683637.923395:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850263552 00000100:00100000:1.0:1789683637.923418:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789683637.923424:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+20:17197:x1876618850263552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789683637.923442:0:17195:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789683637.923455:0:17195:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789683637.923458:0:17195:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789683637.923527:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+20:17197:x1876618850263552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683637.923534:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789683637.923603:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850263552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789683637.923655:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789683637.923661:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176600/0xcf8485587b88a9d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a9d8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683637.923670:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176600/0xcf8485587b88a9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a9d8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683637.923688:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789683637.923691:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0e83ec0800 from 9 10000000:01000000:3.0:1789683637.923693:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789683637.923709:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a9df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683637.923716:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a9df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683637.923725:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a9df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683637.923736:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850263680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789683637.923757:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683637.923777:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c210d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683637.923900:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850263680 00000100:00100000:2.0:1789683637.923905:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850263680 00000100:00100000:2.0:1789683637.923935:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789683637.923941:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7958850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+20:17197:x1876618850263680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683637.923948:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683637.923957:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b88a9e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88a9df expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683637.923982:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b88a9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88a9df expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683637.923998:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b88a9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a9df expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683637.924006:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f9600, rc 0) 00000100:00100000:2.0:1789683637.924035:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7958850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:17197:x1876618850263680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683637.924041:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789683637.924066:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850263680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683637.924075:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a9df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a9e6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683637.924088:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a9df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88a9e6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683637.924121:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850263808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789683637.924254:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683637.924274:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc0775600 going to sleep for 11 seconds 00000100:00100000:2.0:1789683637.924284:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850263808 00000100:00100000:2.0:1789683637.924287:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850263808 00000100:00100000:2.0:1789683637.924301:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789683637.924306:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:17197:x1876618850263808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789683637.924315:0:17193:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789683637.924324:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789683637.924328:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789683637.924387:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:17197:x1876618850263808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 80us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683637.924393:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789683637.924415:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850263808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789683637.924456:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789683637.924461:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a9df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a9e6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683637.924469:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a9e6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683638.822207:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683639.842256:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683639.903052:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850263936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683639.903148:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683639.903207:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850263936 00000100:00100000:0.0:1789683639.903214:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850263936 00000100:00100000:0.0:1789683639.903256:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789683639.903264:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850263936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789683639.903296:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789683639.903384:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850263936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683639.903391:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789683639.903447:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850263936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683639.903714:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683639.903724:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850264064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683639.903767:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683639.909920:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850264064 00000100:00100000:3.0:1789683639.909937:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850264064 00000100:00100000:3.0:1789683639.909993:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789683639.910004:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850264064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789683639.910043:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789683639.910146:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850264064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (6378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683639.910153:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789683639.910218:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850264064:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789683640.863382:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789683641.631441:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789683641.886990:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789683641.963310:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683641.963323:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789683641.963326:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683641.963329:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789683641.963358:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683641.963361:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789683641.963363:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683641.963366:0:14530:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789683641.963388:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850264192:0@lo:400:kworker.0 00000100:00100000:2.0:1789683641.963395:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850264320:0@lo:400:kworker.0 00000100:00100000:1.0:1789683641.964145:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850264576:0@lo:400:kworker.0 00000100:00100000:2.0:1789683641.967365:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683641.967955:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850264832:0@lo:400:kworker.0 00000100:00100000:2.0:1789683641.967997:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683641.968074:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850264320 00000100:00100000:2.0:1789683641.968084:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850264320 00000100:00100000:2.0:1789683641.968148:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789683641.968159:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850264320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683641.968221:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850264320:12345-0@lo:400:kworker.0 Request processed in 64us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683641.968229:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789683641.968279:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850264320:0@lo:400:kworker.0 00000100:00100000:0.0:1789683641.968829:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683641.968864:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850264704:0@lo:400:kworker.0 00000100:00100000:0.0:1789683641.968894:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683641.969774:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683641.969811:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789683641.969819:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850264448:0@lo:400:kworker.0 00000100:00100000:1.0:1789683641.969840:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683641.969855:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850264960:0@lo:400:kworker.0 00000100:00100000:1.0:1789683641.969874:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683641.969904:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850264832 00000100:00100000:0.0:1789683641.969993:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850264576 00000100:00100000:0.0:1789683641.970000:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850264576 00000100:00100000:0.0:1789683641.970034:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789683641.970041:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850264576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683641.970142:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850264576:12345-0@lo:400:kworker.0 Request processed in 101us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683641.970149:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789683641.970192:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850264832 00000100:00100000:1.0:1789683641.970323:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850264704 00000100:00100000:1.0:1789683641.970327:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850264704 00000100:00100000:1.0:1789683641.970338:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850264448 00000100:00100000:1.0:1789683641.970339:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850264448 00000100:00100000:1.0:1789683641.970348:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850264960 00000100:00100000:1.0:1789683641.970349:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850264960 00000100:00100000:2.0:1789683641.971627:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850264192 00000100:00100000:2.0:1789683641.971642:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850264192 00000100:00100000:2.0:1789683641.971710:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789683641.971720:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:3647:x1876618850264192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683641.971849:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:3647:x1876618850264192:12345-0@lo:400:kworker.0 Request processed in 131us (3022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683641.971856:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789683641.971927:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850264192:0@lo:400:kworker.0 00000100:00080000:0.0:1789683641.975470:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683641.975480:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683641.978101:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789683641.978130:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850264832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683641.978247:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850264832:12345-0@lo:400:kworker.0 Request processed in 133us (10248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683641.978255:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789683641.978286:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789683641.978293:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850264704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683641.978331:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850264704:12345-0@lo:400:kworker.0 Request processed in 39us (9436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683641.978337:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789683641.978350:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789683641.978356:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850264448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683641.978385:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850264448:12345-0@lo:400:kworker.0 Request processed in 29us (8543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683641.978390:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789683641.978526:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83eaf800 x1876618850264704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1789683641.978532:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83eae300 x1876618850264832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683641.978542:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850264704:0@lo:400:kworker.0 00000100:00100000:0.0:1789683641.978542:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850264832:0@lo:400:kworker.0 00010000:00080000:0.0:1789683641.980626:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83eaf480 x1876618850264448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683641.980642:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850264448:0@lo:400:kworker.0 00000100:00100000:0.0:1789683641.980656:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850264576:0@lo:400:kworker.0 00000100:00100000:1.0:1789683641.982955:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789683641.982972:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850264960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683641.983085:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850264960:12345-0@lo:400:kworker.0 Request processed in 106us (13196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683641.983093:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789683641.983148:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83eadc00 x1876618850264960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683641.983183:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850264960:0@lo:400:kworker.0 00010000:00010000:3.0:1789683642.914125:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789683643.442003:0:19075:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789683643.935497:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789683644.373717:0:19127:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789683644.374189:0:19127:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789683644.643549:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683629/real 1789683629] req@ffff9f0fc0724700 x1876618850256896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683644 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683644.643590:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fc0724700 x1876618850256896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683644 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683644.643600:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683629/real 1789683629] req@ffff9f0fc0725f80 x1876618850257024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683644 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683644.643612:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fc0725f80 x1876618850257024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683644 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789683644.643631:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f8554b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789683644.643648:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789683644.643652:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850256896:0@lo:8:kworker.0 00000100:00080000:1.0:1789683644.643656:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdbd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789683644.643661:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789683644.643664:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850257024:0@lo:8:kworker.0 00000100:00080000:1.0:1789683644.643829:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683644.643833:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683644.643836:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683644.643838:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683644.643854:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683644.643856:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789683644.643884:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0f8554b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683644.643890:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 543 00000100:00080000:1.0:1789683644.643895:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789683644.643906:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f0f8554b800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683644.643926:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb7999180 x1876618850265600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683644.643939:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683644.643942:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789683644.643943:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdbd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683644.643946:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 543 00000100:00080000:1.0:1789683644.643949:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789683644.643953:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0f8bdbd000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683644.643963:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb7998700 x1876618850265728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683644.644004:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850265088:0@lo:400:kworker.0 00000100:00100000:1.0:1789683644.644072:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683644.644106:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850265856:0@lo:400:kworker.0 00000100:00100000:1.0:1789683644.644138:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683644.644164:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683644.644170:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850265472:0@lo:400:kworker.0 00000100:00100000:1.0:1789683644.644197:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683644.644230:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850265216:0@lo:400:kworker.0 00000100:00100000:1.0:1789683644.644255:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683644.644292:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1876618850265984:0@lo:400:kworker.0 00000100:00100000:1.0:1789683644.644328:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683644.644347:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789683644.644353:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850265344:0@lo:400:kworker.0 00000100:00100000:1.0:1789683644.644375:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683644.644393:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850266112:0@lo:400:kworker.0 00000100:00100000:1.0:1789683644.644412:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683644.644437:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850265600:0@lo:8:kworker.0 00000100:00100000:1.0:1789683644.644463:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683644.644480:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850265728:0@lo:8:kworker.0 00000100:00100000:1.0:1789683644.644500:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683644.644535:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850265856 00000100:00100000:1.0:1789683644.644543:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850265856 00000100:00100000:1.0:1789683644.644589:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850265984 00000100:00100000:1.0:1789683644.644593:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850265984 00000100:00100000:1.0:1789683644.644613:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850265344 00000100:00100000:1.0:1789683644.644616:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850265344 00000100:00100000:1.0:1789683644.644626:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850266112 00000100:00100000:1.0:1789683644.644628:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850266112 00000100:00100000:1.0:1789683644.644643:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789683644.644651:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850265856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683644.644699:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850265856:12345-0@lo:400:kworker.0 Request processed in 49us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683644.644705:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789683644.644721:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789683644.644726:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876618850265984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683644.644751:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876618850265984:12345-0@lo:400:kworker.0 Request processed in 26us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683644.644766:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789683644.644777:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789683644.644805:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850265344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683644.644835:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876618850265344:12345-0@lo:400:kworker.0 Request processed in 53us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683644.644841:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789683644.644851:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789683644.644856:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850266112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683644.644880:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850266112:12345-0@lo:400:kworker.0 Request processed in 24us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683644.644885:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789683644.644902:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850265472 00000100:00100000:1.0:1789683644.644905:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850265472 00000100:00100000:1.0:1789683644.644927:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850265216 00000100:00100000:1.0:1789683644.644929:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850265216 00000100:00100000:1.0:1789683644.644941:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789683644.644947:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850265472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683644.644978:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850265472:12345-0@lo:400:kworker.0 Request processed in 32us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683644.644984:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789683644.644994:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789683644.644999:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850265216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683644.645022:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850265216:12345-0@lo:400:kworker.0 Request processed in 23us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683644.645026:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789683644.645063:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850265600 00000100:00100000:1.0:1789683644.645066:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850265600 00000100:00100000:1.0:1789683644.645080:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850265728 00000100:00100000:1.0:1789683644.645082:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850265728 00000100:00100000:1.0:1789683644.645090:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683644.645094:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1876618850265600:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789683644.645118:0:18708:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:1.0:1789683644.645145:0:18708:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b88a9ed 00002000:00100000:1.0:1789683644.645158:0:18708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9f0fc0500000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789683644.645162:0:18708:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1789683644.645165:0:18708:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789683644.645328:0:18708:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789683644.645349:0:18708:0:(import.c:65:import_set_state_nolock()) ffff9f0fc0502800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683644.645385:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1876618850265600:12345-0@lo:8:kworker.0 Request processed in 290us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683644.645391:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683644.645402:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683644.645406:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1876618850265728:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789683644.645417:0:18708:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1789683644.647144:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683644.647153:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683644.647749:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850265088 00000100:00100000:3.0:1789683644.647761:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850265088 00000100:00100000:3.0:1789683644.647918:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789683644.647927:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:3650:x1876618850265088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683644.648002:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:3650:x1876618850265088:12345-0@lo:400:kworker.0 Request processed in 77us (3930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683644.648009:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1789683644.649227:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb7998380 x1876618850265344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683644.649411:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876618850265344:0@lo:400:kworker.0 00010000:00080000:0.0:1789683644.649442:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb7998000 x1876618850266112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683644.649452:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850266112:0@lo:400:kworker.0 00000100:00100000:0.0:1789683644.649465:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850265216:0@lo:400:kworker.0 00010000:00080000:0.0:1789683644.649477:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb799ad80 x1876618850265984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683644.649485:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1876618850265984:0@lo:400:kworker.0 00000100:00100000:0.0:1789683644.649534:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850265472:0@lo:400:kworker.0 00000100:00100000:0.0:1789683644.649545:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850265088:0@lo:400:kworker.0 00010000:00080000:0.0:1789683644.649557:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb7998e00 x1876618850265856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683644.649579:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850265856:0@lo:400:kworker.0 00010000:00080000:0.0:1789683644.654984:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb7999180 x1876618850265600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789683664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683644.655000:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789683644.655011:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789683644.655035:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789683644.655041:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789683644.655045:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f8554b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789683644.655178:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789683644.655185:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850265600:0@lo:8:kworker.0 00000004:00080000:0.0:1789683644.655217:0:17942:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789683644.655326:0:17942:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 558704541374ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789683644.655332:0:17942:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1789683644.655618:0:17943:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789683644.655642:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eafb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17943:1876618850266368:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789683644.655701:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683644.655724:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc0775600 going to sleep for 11 seconds 00000100:00100000:2.0:1789683644.655745:0:18709:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789683644.655751:0:18709:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789683644.655763:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683644.655773:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850266240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683644.655818:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683644.660891:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850266368 00000100:00100000:2.0:1789683644.660909:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850266368 00000100:00080000:2.0:1789683644.660980:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683644.661219:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683644.661230:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17943:x1876618850266368:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789683644.664439:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850266240 00000100:00100000:2.0:1789683644.664453:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850266240 00000100:00100000:2.0:1789683644.664521:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683644.664531:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1876618850266240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789683644.664572:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789683644.664661:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1876618850266240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (8841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683644.664668:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789683644.664716:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83eaf800 x1876618850266240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683660 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683644.664737:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850266240:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1789683644.677067:0:17933:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1789683644.678476:0:19141:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1789683644.678484:0:19141:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789683644.678583:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17943:x1876618850266368:12345-0@lo:7:osp-pre-0-1.0 Request processed in 17351us (22877us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683644.678603:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789683644.678662:0:17943:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83eafb80 x1876618850266368/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789683660 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683644.678677:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eafb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17943:1876618850266368:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789683644.678691:0:17943:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789683644.678729:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eafb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17943:1876618850266496:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789683644.678761:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683644.678801:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc0775600 going to sleep for 11 seconds 00000100:00100000:2.0:1789683644.678819:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850266496 00000100:00100000:2.0:1789683644.678826:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850266496 00000100:00100000:2.0:1789683644.678863:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683644.679139:0:18709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17943:x1876618850266496:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789683644.679165:0:18709:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1789683644.679201:0:18709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17943:x1876618850266496:12345-0@lo:5:osp-pre-0-1.0 Request processed in 68us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683644.679207:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789683644.679237:0:17943:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83eafb80 x1876618850266496/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683660 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683644.679440:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eafb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17943:1876618850266496:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789683644.679451:0:17943:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789683644.679480:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eafb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17943:1876618850266624:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789683644.679505:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683644.679520:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc0775600 going to sleep for 11 seconds 00000100:00100000:2.0:1789683644.679534:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850266624 00000100:00100000:2.0:1789683644.679546:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850266624 00000100:00100000:2.0:1789683644.679583:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789683644.679590:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17943:x1876618850266624:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789683644.679615:0:19141:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1789683644.696530:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1876618850265728:12345-0@lo:8:kworker.0 Request processed in 51110us (52015us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789683644.696547:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789683644.696555:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdbd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789683644.696575:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789683644.696581:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850265728:0@lo:8:kworker.0 00000001:00080000:0.0:1789683644.723454:0:18704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1789683644.723475:0:18704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789683644.723764:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17943:x1876618850266624:12345-0@lo:5:osp-pre-0-1.0 Request processed in 44168us (44251us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789683644.723777:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789683644.728237:0:17943:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83eafb80 x1876618850266624/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683660 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683644.728254:0:17943:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789683644.728260:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eafb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17943:1876618850266624:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789683644.728277:0:17943:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1789683644.731128:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a13b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17943:1876618850266752:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789683644.731205:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683644.731259:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e836bda80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683644.731636:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850266752 00000100:00100000:3.0:1789683644.731650:0:17211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850266752 00000100:00100000:3.0:1789683644.731725:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683644.731736:0:17211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17943:x1876618850266752:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789683644.731827:0:17211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17943:x1876618850266752:12345-0@lo:900:osp-pre-0-1.0 Request processed in 93us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683644.731835:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789683644.731877:0:17943:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb7a13b80 x1876618850266752/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789683660 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683644.731892:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a13b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17943:1876618850266752:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1789683644.969633:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683645.023055:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850266880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683645.023127:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683645.023243:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850266880 00000100:00100000:1.0:1789683645.023252:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850266880 00000100:00100000:1.0:1789683645.023299:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789683645.023307:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850266880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683645.023342:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789683645.024254:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683645.024270:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850267008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789683645.024305:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683645.024334:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850267008 00000100:00100000:2.0:1789683645.024339:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850267008 00000100:00100000:2.0:1789683645.024361:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789683645.024367:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850267008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789683645.024390:0:17941:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789683645.024425:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850267008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683645.024431:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789683645.024479:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850267008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683645.024823:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850266880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1516us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683645.024830:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789683645.027167:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850266880:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1789683645.274528:0:19178:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789683645.274764:0:19178:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789683645.982953:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789683646.496562:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789683647.007243:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683648.034266:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683649.054964:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683650.079194:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789683650.145745:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683650.145752:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683650.145755:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683650.145758:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789683650.145777:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683650.145799:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789683650.145804:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdbd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683650.145813:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 558 00000100:00080000:1.0:1789683650.145819:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789683650.145832:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0f8bdbd000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683650.145856:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb7a10a80 x1876618850267776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683650.145922:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3648:1876618850267136:0@lo:400:kworker.0 00000100:00100000:1.0:1789683650.145995:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683650.146047:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850267648:0@lo:400:kworker.0 00000100:00100000:1.0:1789683650.146074:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683650.146102:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789683650.146108:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850267520:0@lo:400:kworker.0 00000100:00100000:1.0:1789683650.146148:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683650.146167:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850268160:0@lo:400:kworker.0 00000100:00100000:1.0:1789683650.146191:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683650.146222:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850267264:0@lo:400:kworker.0 00000100:00100000:1.0:1789683650.146244:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683650.146261:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850267904:0@lo:400:kworker.0 00000100:00100000:1.0:1789683650.146279:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683650.146295:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789683650.146301:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850267392:0@lo:400:kworker.0 00000100:00100000:1.0:1789683650.146320:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683650.146334:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850268032:0@lo:400:kworker.0 00000100:00100000:1.0:1789683650.146350:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683650.146376:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850267776:0@lo:8:kworker.0 00000100:00100000:1.0:1789683650.146397:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683650.146430:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850267136 00000100:00100000:1.0:1789683650.146437:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850267136 00000100:00100000:1.0:1789683650.146492:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789683650.146502:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:3648:x1876618850267136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683650.146552:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:3648:x1876618850267136:12345-0@lo:400:kworker.0 Request processed in 52us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683650.146560:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789683650.146605:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850267648 00000100:00100000:1.0:1789683650.146608:0:18710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850267648 00000100:00100000:1.0:1789683650.146636:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850267776 00000100:00100000:1.0:1789683650.146639:0:18710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850267776 00000100:00100000:1.0:1789683650.146651:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683650.146657:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850267648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683650.146689:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850267648:12345-0@lo:400:kworker.0 Request processed in 32us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683650.146695:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683650.146706:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683650.146710:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1876618850267776:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789683650.146729:0:18710:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789683650.149547:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683650.149569:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850268288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789683650.149634:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683650.149680:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850267520 00000100:00100000:2.0:1789683650.149687:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850267520 00000100:00100000:2.0:1789683650.149727:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850267264 00000100:00100000:2.0:1789683650.149731:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850267264 00000100:00100000:2.0:1789683650.149742:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850268288 00000100:00100000:2.0:1789683650.149745:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850268288 00000100:00100000:2.0:1789683650.149757:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789683650.149764:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850267520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683650.149832:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850267520:12345-0@lo:400:kworker.0 Request processed in 68us (3683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683650.149852:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789683650.149870:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789683650.149876:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1876618850267264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683650.149916:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1876618850267264:12345-0@lo:400:kworker.0 Request processed in 40us (3671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683650.149922:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789683650.149933:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789683650.149939:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850268288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789683650.149962:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789683650.149992:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850268288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683650.149998:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789683650.150037:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850268288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789683650.150074:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850267264:0@lo:400:kworker.0 00000100:00100000:3.0:1789683650.150414:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850268544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683650.150447:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683650.150481:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683650.150487:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850268416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683650.150513:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683650.150540:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850268544 00000100:00100000:3.0:1789683650.150543:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850268544 00000100:00100000:3.0:1789683650.150565:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789683650.150571:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850268544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789683650.150599:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789683650.150631:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850268544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683650.150637:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789683650.150663:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850268544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683650.154887:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850268160 00000100:00100000:3.0:1789683650.154903:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850268160 00000100:00100000:3.0:1789683650.154971:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850267904 00000100:00100000:3.0:1789683650.154975:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850267904 00000100:00100000:3.0:1789683650.154988:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850267392 00000100:00100000:3.0:1789683650.154991:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850267392 00000100:00100000:3.0:1789683650.155003:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850268032 00000100:00100000:3.0:1789683650.155006:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850268032 00000100:00100000:3.0:1789683650.155027:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789683650.155037:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850268160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683650.155138:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850268160:12345-0@lo:400:kworker.0 Request processed in 102us (8945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683650.155145:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789683650.155162:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789683650.155167:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850267904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683650.155213:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850267904:12345-0@lo:400:kworker.0 Request processed in 46us (8933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683650.155219:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789683650.155229:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789683650.155235:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850267392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683650.155263:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850267392:12345-0@lo:400:kworker.0 Request processed in 28us (8942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683650.155284:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789683650.155295:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789683650.155301:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850268032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683650.155329:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850268032:12345-0@lo:400:kworker.0 Request processed in 28us (8978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683650.155334:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789683650.155406:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb7a10700 x1876618850267392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683650.155420:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850267392:0@lo:400:kworker.0 00010000:00080000:3.0:1789683650.155440:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb7a10380 x1876618850268032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683650.155450:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850268032:0@lo:400:kworker.0 00010000:00080000:3.0:1789683650.155475:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb7a11180 x1876618850267904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683650.155486:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850267904:0@lo:400:kworker.0 00000100:00100000:2.0:1789683650.156144:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850268416 00000100:00100000:2.0:1789683650.156151:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850268416 00000100:00100000:2.0:1789683650.156195:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789683650.156202:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850268416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789683650.156228:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789683650.156285:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850268416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (5771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683650.156291:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789683650.156328:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e8451dc00 x1876618850268416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683650.156360:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850268416:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789683650.159103:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683650.159113:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789683650.159115:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683650.159171:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850267520:0@lo:400:kworker.0 00010000:00080000:2.0:1789683650.159193:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb7a13800 x1876618850268160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683650.159203:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850268160:0@lo:400:kworker.0 00000100:00100000:2.0:1789683650.159213:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3648:1876618850267136:0@lo:400:kworker.0 00010000:00080000:2.0:1789683650.159223:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb7a12300 x1876618850267648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683650.159231:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850267648:0@lo:400:kworker.0 00000100:00100000:1.0:1789683650.175323:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1876618850267776:12345-0@lo:8:kworker.0 Request processed in 28601us (28914us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789683650.175343:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789683650.175525:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdbd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683650.175533:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789683650.175538:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850267776:0@lo:8:kworker.0 00010000:00010000:3.0:1789683651.119822:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683651.168834:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683630/real 1789683630] req@ffff9f0fa7246300 x1876618850258176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683650 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683651.168861:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fa7246300 x1876618850258176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683650 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683651.168870:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683630/real 1789683630] req@ffff9f0fa7246a00 x1876618850258304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683650 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683651.168904:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0fa7246a00 x1876618850258304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683650 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789683651.168922:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83446000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683651.168935:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789683651.168938:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850258176:0@lo:8:kworker.0 00000100:00080000:2.0:1789683651.168944:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb240d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683651.168947:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789683651.168950:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850258304:0@lo:8:kworker.0 00000100:00080000:2.0:1789683651.169013:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683651.169017:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789683651.169019:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0e83446000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789683651.169024:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 544 00000100:00080000:2.0:1789683651.169029:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789683651.169039:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f0e83446000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683651.169057:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83eac000 x1876618850268928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789683651.169081:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683651.169084:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789683651.169086:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0fb240d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789683651.169089:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 544 00000100:00080000:2.0:1789683651.169091:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789683651.169096:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0fb240d000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683651.169107:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83eaed80 x1876618850269056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789683651.169149:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683651.169152:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789683651.169154:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdbd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789683651.169158:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 564 00000100:00080000:2.0:1789683651.169160:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789683651.169165:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0f8bdbd000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683651.169175:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb7a12680 x1876618850269568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789683651.169211:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850268672:0@lo:400:kworker.0 00000100:00100000:2.0:1789683651.169272:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683651.169304:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850269440:0@lo:400:kworker.0 00000100:00100000:2.0:1789683651.169329:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683651.169350:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789683651.169371:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850268800:0@lo:400:kworker.0 00000100:00100000:2.0:1789683651.169394:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683651.169412:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850269696:0@lo:400:kworker.0 00000100:00100000:2.0:1789683651.169434:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683651.169471:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850269312:0@lo:400:kworker.0 00000100:00100000:2.0:1789683651.169495:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683651.169510:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850269952:0@lo:400:kworker.0 00000100:00100000:2.0:1789683651.169528:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683651.169544:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850269184:0@lo:400:kworker.0 00000100:00100000:2.0:1789683651.169558:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850268672 00000100:00100000:2.0:1789683651.169566:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850268672 00000100:00100000:3.0:1789683651.169571:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683651.169589:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850269824:0@lo:400:kworker.0 00000100:00100000:3.0:1789683651.169608:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683651.169619:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789683651.169634:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:3647:x1876618850268672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683651.169636:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850269440 00000100:00100000:3.0:1789683651.169639:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850269440 00000100:00100000:3.0:1789683651.169665:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683651.169676:0:18709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850269440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683651.169681:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:3647:x1876618850268672:12345-0@lo:400:kworker.0 Request processed in 49us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683651.169687:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789683651.169705:0:18709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850269440:12345-0@lo:400:kworker.0 Request processed in 30us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683651.169709:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789683651.169719:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850268800 00000100:00100000:2.0:1789683651.169723:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850268800 00000100:00100000:2.0:1789683651.169745:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850269312 00000100:00100000:2.0:1789683651.169748:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850269312 00000100:00100000:2.0:1789683651.169762:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789683651.169767:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850268800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683651.169812:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850269696 00000100:00100000:3.0:1789683651.169816:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850269696 00000100:00100000:2.0:1789683651.169833:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850268800:12345-0@lo:400:kworker.0 Request processed in 66us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683651.169835:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850269952 00000100:00100000:3.0:1789683651.169837:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850269952 00000100:00100000:2.0:1789683651.169840:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789683651.169846:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850269184 00000100:00100000:3.0:1789683651.169849:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850269184 00000100:00100000:2.0:1789683651.169850:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789683651.169855:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850269312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683651.169857:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850269824 00000100:00100000:3.0:1789683651.169859:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850269824 00000100:00100000:3.0:1789683651.169870:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789683651.169875:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850269696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683651.169885:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850269312:12345-0@lo:400:kworker.0 Request processed in 30us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683651.169890:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789683651.169902:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850269696:12345-0@lo:400:kworker.0 Request processed in 27us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683651.169936:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850269312:0@lo:400:kworker.0 00000100:00100000:2.0:1789683651.169962:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850268800:0@lo:400:kworker.0 00010000:00080000:2.0:1789683651.169973:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb7a13800 x1876618850269696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683651.169981:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789683651.169982:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850269696:0@lo:400:kworker.0 00000100:00100000:2.0:1789683651.169989:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850268672:0@lo:400:kworker.0 00000100:00100000:3.0:1789683651.169994:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789683651.169999:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850269952:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789683651.170008:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb7a12300 x1876618850269440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683651.170016:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850269440:0@lo:400:kworker.0 00000100:00100000:3.0:1789683651.170029:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876618850269952:12345-0@lo:400:kworker.0 Request processed in 30us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683651.170034:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789683651.170043:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb7a11180 x1876618850269952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683651.170044:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789683651.170049:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850269184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683651.170051:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1876618850269952:0@lo:400:kworker.0 00000100:00100000:3.0:1789683651.170082:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850269184:12345-0@lo:400:kworker.0 Request processed in 32us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683651.170087:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789683651.170092:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83eafb80 x1876618850269184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683651.170100:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850269184:0@lo:400:kworker.0 00000100:00100000:3.0:1789683651.170103:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789683651.170109:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850269824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683651.170145:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850269824:12345-0@lo:400:kworker.0 Request processed in 36us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683651.170150:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789683651.170184:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850268928:0@lo:8:kworker.0 00000100:00100000:3.0:1789683651.170207:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683651.170229:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850269056:0@lo:8:kworker.0 00000100:00100000:3.0:1789683651.170247:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683651.170264:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850269568:0@lo:8:kworker.0 00000100:00100000:3.0:1789683651.170287:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683651.170309:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850268928 00000100:00100000:3.0:1789683651.170313:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850268928 00000100:00100000:3.0:1789683651.170325:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850269056 00000100:00100000:3.0:1789683651.170328:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850269056 00000100:00100000:3.0:1789683651.170334:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850269568 00000100:00100000:3.0:1789683651.170336:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850269568 00000100:00100000:0.0:1789683651.170344:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683651.170354:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789683651.170359:0:18709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1876618850269056:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789683651.170361:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1876618850268928:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789683651.170383:0:18709:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1789683651.170385:0:19141:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 565 last 0 00000100:00100000:3.0:1789683651.170413:0:18709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1876618850269056:12345-0@lo:8:kworker.0 Request processed in 53us (164us total) trans 0 rc -19/-19 00000020:00000080:0.0:1789683651.170418:0:19141:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b88a9f4 00002000:00100000:0.0:1789683651.170431:0:19141:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9f0f8721d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789683651.170435:0:19141:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789683651.170437:0:19141:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789683651.170535:0:19141:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789683651.170557:0:19141:0:(import.c:65:import_set_state_nolock()) ffff9f0f8721b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683651.170560:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789683651.170572:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789683651.170576:0:18709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1876618850269568:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789683651.170586:0:18709:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789683651.170591:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1876618850268928:12345-0@lo:8:kworker.0 Request processed in 241us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683651.170598:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683651.170629:0:18709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1876618850269568:12345-0@lo:8:kworker.0 Request processed in 51us (341us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789683651.170634:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789683651.170657:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83eac000 x1876618850268928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789683676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683651.170665:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789683651.170671:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789683651.170679:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789683651.170683:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789683651.170685:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e83446000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789683651.170697:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789683651.170702:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850268928:0@lo:8:kworker.0 00000100:00080000:3.0:1789683651.170711:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb240d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683651.170714:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789683651.170717:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850269056:0@lo:8:kworker.0 00000100:00080000:3.0:1789683651.170722:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdbd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683651.170725:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789683651.170727:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850269568:0@lo:8:kworker.0 00000004:00080000:3.0:1789683651.171224:0:17225:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1789683651.171240:0:17225:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17225:1876618850270208:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789683651.171266:0:17225:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683651.171283:0:17225:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88818240 going to sleep for 11 seconds 00000100:00100000:3.0:1789683651.171295:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850270208 00000100:00100000:3.0:1789683651.171299:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850270208 00000100:00100000:3.0:1789683651.171327:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789683651.171339:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17225:x1876618850270208:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1789683651.173477:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683651.173498:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683651.173520:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850270080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683651.173588:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789683651.173660:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fb7a11880 x1876618850269824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683651.173675:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850269824:0@lo:400:kworker.0 00000004:00080000:1.0:1789683651.173998:0:17224:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789683651.174086:0:17224:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565223301886ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789683651.174095:0:17224:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1789683651.176497:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850270080 00000100:00100000:0.0:1789683651.176514:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850270080 00000100:00100000:0.0:1789683651.176586:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683651.176598:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876618850270080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683651.176627:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789683651.176723:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876618850270080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (3135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683651.176731:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789683651.176846:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e8451ce00 x1876618850270080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683651.176870:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850270080:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1789683651.182847:0:19141:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789683651.182872:0:19141:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789683651.182878:0:19141:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:3.0:1789683651.199324:0:17180:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789683651.200236:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683651.200248:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c25e5a9e/0xcf8485587b88a9fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.200266:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1789683651.200271:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683651.200278:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c25e5a9e/0xcf8485587b88a9fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.200296:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c25e5a9e/0xcf8485587b88a9fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.200306:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c25e5a9e/0xcf8485587b88a9fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.200314:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c25e5a9e/0xcf8485587b88a9fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.200340:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683651.200884:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683651.200891:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa97db86/0xcf8485587b88aa02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.200966:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1789683651.200970:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683651.200974:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa97db86/0xcf8485587b88aa02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.200985:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa97db86/0xcf8485587b88aa02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.200993:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa97db86/0xcf8485587b88aa02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.200999:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa97db86/0xcf8485587b88aa02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.201016:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789683651.201027:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683651.201033:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c25e5a9e/0xcf8485587b88a9fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.201041:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683651.201046:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c25e5a9e/0xcf8485587b88a9fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.201055:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c25e5a9e/0xcf8485587b88a9fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.201081:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c25e5a9e/0xcf8485587b88a9fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.201088:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c25e5a9e/0xcf8485587b88a9fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.201105:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683651.201108:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa97db86/0xcf8485587b88aa02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.201115:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176a00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683651.201118:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa97db86/0xcf8485587b88aa02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.201183:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa97db86/0xcf8485587b88aa02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.201193:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa97db86/0xcf8485587b88aa02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.201199:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa97db86/0xcf8485587b88aa02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.201212:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683651.201213:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683651.201220:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683651.201557:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683651.202282:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683651.202292:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ce8e092/0xcf8485587b88aa09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.202305:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1789683651.202309:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683651.202313:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ce8e092/0xcf8485587b88aa09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.202324:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ce8e092/0xcf8485587b88aa09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.202333:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ce8e092/0xcf8485587b88aa09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.202340:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ce8e092/0xcf8485587b88aa09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.202363:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789683651.202875:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683651.202884:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ce8e092/0xcf8485587b88aa09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.202906:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177000 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683651.202911:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ce8e092/0xcf8485587b88aa09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.202932:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ce8e092/0xcf8485587b88aa09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.202950:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ce8e092/0xcf8485587b88aa09 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.202958:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ce8e092/0xcf8485587b88aa09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.202978:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.202980:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.202981:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683651.204025:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683651.204037:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000958627d3/0xcf8485587b88aa10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.204053:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1789683651.204057:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683651.204063:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000958627d3/0xcf8485587b88aa10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.204092:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000958627d3/0xcf8485587b88aa10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.204101:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000958627d3/0xcf8485587b88aa10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.204109:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000958627d3/0xcf8485587b88aa10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.204128:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683651.204580:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683651.204586:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000162474c1/0xcf8485587b88aa17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.204595:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1789683651.204599:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683651.204603:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000162474c1/0xcf8485587b88aa17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.204612:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000162474c1/0xcf8485587b88aa17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.204619:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000162474c1/0xcf8485587b88aa17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.204639:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000162474c1/0xcf8485587b88aa17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.204661:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789683651.204669:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683651.204675:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000958627d3/0xcf8485587b88aa10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.204684:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683651.204689:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000958627d3/0xcf8485587b88aa10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.204698:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000958627d3/0xcf8485587b88aa10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.204714:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000958627d3/0xcf8485587b88aa10 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.204731:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000958627d3/0xcf8485587b88aa10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.204750:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683651.204754:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000162474c1/0xcf8485587b88aa17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.204760:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176000 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683651.204763:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000162474c1/0xcf8485587b88aa17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.204772:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000162474c1/0xcf8485587b88aa17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.204803:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000162474c1/0xcf8485587b88aa17 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.204811:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000162474c1/0xcf8485587b88aa17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.204823:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.204824:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.204826:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683651.205054:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683651.205073:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015e4c65c/0xcf8485587b88aa1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.205082:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1789683651.205085:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683651.205089:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015e4c65c/0xcf8485587b88aa1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.205098:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015e4c65c/0xcf8485587b88aa1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.205105:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015e4c65c/0xcf8485587b88aa1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.205112:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015e4c65c/0xcf8485587b88aa1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.205130:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683651.205682:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683651.205688:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004681c271/0xcf8485587b88aa25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.205703:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1789683651.205706:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683651.205710:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004681c271/0xcf8485587b88aa25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.205719:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004681c271/0xcf8485587b88aa25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.205739:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004681c271/0xcf8485587b88aa25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.205747:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004681c271/0xcf8485587b88aa25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.205755:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789683651.206061:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683651.206068:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015e4c65c/0xcf8485587b88aa1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206082:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683651.206087:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015e4c65c/0xcf8485587b88aa1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206096:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015e4c65c/0xcf8485587b88aa1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206111:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015e4c65c/0xcf8485587b88aa1e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206119:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015e4c65c/0xcf8485587b88aa1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206136:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1789683651.206139:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683651.206139:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004681c271/0xcf8485587b88aa25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.206144:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008cc48ae/0xcf8485587b88aa2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206146:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683651.206149:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004681c271/0xcf8485587b88aa25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.206152:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1789683651.206156:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683651.206158:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004681c271/0xcf8485587b88aa25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.206160:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008cc48ae/0xcf8485587b88aa2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206168:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004681c271/0xcf8485587b88aa25 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.206169:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008cc48ae/0xcf8485587b88aa2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206180:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004681c271/0xcf8485587b88aa25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.206185:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008cc48ae/0xcf8485587b88aa2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.206192:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008cc48ae/0xcf8485587b88aa2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206192:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.206194:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.206196:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683651.206213:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789683651.206216:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683651.206219:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008cc48ae/0xcf8485587b88aa2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206226:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81676800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683651.206229:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008cc48ae/0xcf8485587b88aa2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206237:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008cc48ae/0xcf8485587b88aa2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206248:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008cc48ae/0xcf8485587b88aa2c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206255:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008cc48ae/0xcf8485587b88aa2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206269:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.206271:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.206272:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683651.206547:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683651.206554:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afb8ab59/0xcf8485587b88aa33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.206562:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1789683651.206565:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683651.206568:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afb8ab59/0xcf8485587b88aa33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.206576:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afb8ab59/0xcf8485587b88aa33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.206583:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afb8ab59/0xcf8485587b88aa33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.206590:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afb8ab59/0xcf8485587b88aa33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.206618:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789683651.206626:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683651.206630:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afb8ab59/0xcf8485587b88aa33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206637:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677000 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683651.206641:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afb8ab59/0xcf8485587b88aa33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206649:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afb8ab59/0xcf8485587b88aa33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206660:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afb8ab59/0xcf8485587b88aa33 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206667:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afb8ab59/0xcf8485587b88aa33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.206680:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.206682:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.206684:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683651.207041:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683651.207047:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8ba7858/0xcf8485587b88aa3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.207056:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1789683651.207059:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683651.207063:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8ba7858/0xcf8485587b88aa3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.207071:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8ba7858/0xcf8485587b88aa3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.207079:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8ba7858/0xcf8485587b88aa3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.207086:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8ba7858/0xcf8485587b88aa3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.207104:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683651.207489:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683651.207496:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8ba7858/0xcf8485587b88aa3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.207503:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683651.207513:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8ba7858/0xcf8485587b88aa3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.207521:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8ba7858/0xcf8485587b88aa3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.207536:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8ba7858/0xcf8485587b88aa3a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.207542:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8ba7858/0xcf8485587b88aa3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.207559:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683651.207561:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683651.207562:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683651.208925:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683651.208937:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f184611/0xcf8485587b88aa41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.208949:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1789683651.208959:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683651.208965:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f184611/0xcf8485587b88aa41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.208977:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f184611/0xcf8485587b88aa41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.208986:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f184611/0xcf8485587b88aa41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.208993:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f184611/0xcf8485587b88aa41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.209007:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683651.209229:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683651.209236:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f184611/0xcf8485587b88aa41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.209244:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81676400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683651.209248:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f184611/0xcf8485587b88aa41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.209256:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f184611/0xcf8485587b88aa41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.209271:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f184611/0xcf8485587b88aa41 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.209285:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f184611/0xcf8485587b88aa41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.209302:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683651.209304:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683651.209306:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683651.209484:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683651.209491:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3bf97b1/0xcf8485587b88aa48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.209499:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1789683651.209503:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683651.209506:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3bf97b1/0xcf8485587b88aa48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.209515:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3bf97b1/0xcf8485587b88aa48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.209523:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3bf97b1/0xcf8485587b88aa48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.209535:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3bf97b1/0xcf8485587b88aa48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.209549:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683651.210200:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683651.210207:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3bf97b1/0xcf8485587b88aa48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.210216:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677e00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683651.210220:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3bf97b1/0xcf8485587b88aa48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.210228:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3bf97b1/0xcf8485587b88aa48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.210240:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3bf97b1/0xcf8485587b88aa48 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.210248:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3bf97b1/0xcf8485587b88aa48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.210263:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683651.210265:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683651.210267:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.210687:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683651.214553:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683651.214567:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dcabb41/0xcf8485587b88aa4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.214585:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1789683651.214589:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683651.214595:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dcabb41/0xcf8485587b88aa4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.214609:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dcabb41/0xcf8485587b88aa4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.214618:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dcabb41/0xcf8485587b88aa4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.214625:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dcabb41/0xcf8485587b88aa4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.214650:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789683651.215872:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683651.215883:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dcabb41/0xcf8485587b88aa4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.215896:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683651.215900:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dcabb41/0xcf8485587b88aa4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.215920:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dcabb41/0xcf8485587b88aa4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.215943:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dcabb41/0xcf8485587b88aa4f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.215951:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dcabb41/0xcf8485587b88aa4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.215983:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683651.215986:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683651.215987:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683651.217193:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683651.217205:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091ab57d7/0xcf8485587b88aa56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.217225:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1789683651.217228:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683651.217234:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091ab57d7/0xcf8485587b88aa56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.217248:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091ab57d7/0xcf8485587b88aa56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.217258:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091ab57d7/0xcf8485587b88aa56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.217266:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091ab57d7/0xcf8485587b88aa56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.217290:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789683651.217603:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683651.217610:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091ab57d7/0xcf8485587b88aa56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.217619:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81676c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683651.217624:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091ab57d7/0xcf8485587b88aa56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.217645:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091ab57d7/0xcf8485587b88aa56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.217662:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091ab57d7/0xcf8485587b88aa56 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.217670:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091ab57d7/0xcf8485587b88aa56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.217688:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.217690:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.217692:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683651.217744:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683651.217750:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a29030/0xcf8485587b88aa5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.217757:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1789683651.217760:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683651.217764:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a29030/0xcf8485587b88aa5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.217772:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a29030/0xcf8485587b88aa5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.217809:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a29030/0xcf8485587b88aa5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.217816:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a29030/0xcf8485587b88aa5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.217828:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683651.218939:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683651.218949:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a685167/0xcf8485587b88aa64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.218960:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1789683651.218964:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683651.218969:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a685167/0xcf8485587b88aa64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.218980:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a685167/0xcf8485587b88aa64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.218988:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a685167/0xcf8485587b88aa64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.218995:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a685167/0xcf8485587b88aa64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683651.219041:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789683651.219101:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683651.219107:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a29030/0xcf8485587b88aa5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.219116:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677a00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683651.219120:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a29030/0xcf8485587b88aa5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.219129:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a29030/0xcf8485587b88aa5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.219146:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a29030/0xcf8485587b88aa5d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.219165:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a29030/0xcf8485587b88aa5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.219188:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683651.219191:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a685167/0xcf8485587b88aa64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.219198:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81676200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683651.219201:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a685167/0xcf8485587b88aa64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.219208:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a685167/0xcf8485587b88aa64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.219219:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a685167/0xcf8485587b88aa64 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.219225:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a685167/0xcf8485587b88aa64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.219238:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.219239:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.219241:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683651.219721:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789683651.220458:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789683651.220467:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000242cd133/0xcf8485587b88aa6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.220480:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789683651.220484:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683651.220489:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000242cd133/0xcf8485587b88aa6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.220503:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000242cd133/0xcf8485587b88aa6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.220512:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000242cd133/0xcf8485587b88aa6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.220519:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000242cd133/0xcf8485587b88aa6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.220540:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789683651.220594:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683651.220600:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000242cd133/0xcf8485587b88aa6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.220613:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683651.220617:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000242cd133/0xcf8485587b88aa6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.220626:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000242cd133/0xcf8485587b88aa6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.220640:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000242cd133/0xcf8485587b88aa6b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.220647:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000242cd133/0xcf8485587b88aa6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.220661:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.220662:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.220664:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789683651.221058:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789683651.221065:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f6369ca/0xcf8485587b88aa72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.221083:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789683651.221086:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683651.221090:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f6369ca/0xcf8485587b88aa72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.221099:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f6369ca/0xcf8485587b88aa72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.221107:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f6369ca/0xcf8485587b88aa72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.221114:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f6369ca/0xcf8485587b88aa72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.221128:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789683651.221136:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683651.221141:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f6369ca/0xcf8485587b88aa72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.221149:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454c400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683651.221152:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f6369ca/0xcf8485587b88aa72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.221160:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f6369ca/0xcf8485587b88aa72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.221182:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f6369ca/0xcf8485587b88aa72 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.221188:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f6369ca/0xcf8485587b88aa72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.221201:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683651.221203:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683651.221205:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789683651.221893:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789683651.221900:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000799bd6de/0xcf8485587b88aa79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.221910:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789683651.221924:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683651.221930:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000799bd6de/0xcf8485587b88aa79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.221940:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000799bd6de/0xcf8485587b88aa79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.221947:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000799bd6de/0xcf8485587b88aa79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.221953:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000799bd6de/0xcf8485587b88aa79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.221975:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789683651.223063:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789683651.223074:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88aa80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.223085:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789683651.223089:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683651.223095:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88aa80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.223106:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88aa80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.223115:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88aa80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.223122:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88aa80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.223137:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789683651.223147:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683651.223153:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000799bd6de/0xcf8485587b88aa79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.223159:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454d200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683651.223174:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000799bd6de/0xcf8485587b88aa79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.223183:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000799bd6de/0xcf8485587b88aa79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.223199:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000799bd6de/0xcf8485587b88aa79 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.223206:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000799bd6de/0xcf8485587b88aa79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.223219:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683651.223222:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88aa80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.223227:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454ca00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683651.223230:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88aa80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.223236:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88aa80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.223245:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88aa80 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.223252:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b3bf4fa/0xcf8485587b88aa80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.223268:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683651.223270:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683651.223272:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.223292:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683651.225105:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683651.225116:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88aa87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.225132:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=565s v=(0 0) 00010000:00010000:2.0:1789683651.225136:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683651.225142:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88aa87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.225170:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88aa87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.225179:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88aa87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.225186:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88aa87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.225209:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789683651.226565:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683651.226576:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88aa87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.226589:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9000 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683651.226594:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88aa87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.226606:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88aa87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.226628:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88aa87 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.226637:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3269a81/0xcf8485587b88aa87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.226659:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683651.226661:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683651.226663:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789683651.229222:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789683651.229236:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b63c5b3e/0xcf8485587b88aa8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.229267:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789683651.229271:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683651.229277:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b63c5b3e/0xcf8485587b88aa8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.229290:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b63c5b3e/0xcf8485587b88aa8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.229299:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b63c5b3e/0xcf8485587b88aa8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.229307:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b63c5b3e/0xcf8485587b88aa8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.229332:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789683651.230017:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683651.230026:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b63c5b3e/0xcf8485587b88aa8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.230036:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454c000 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683651.230041:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b63c5b3e/0xcf8485587b88aa8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.230050:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b63c5b3e/0xcf8485587b88aa8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.230068:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b63c5b3e/0xcf8485587b88aa8e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.230074:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b63c5b3e/0xcf8485587b88aa8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.230101:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.230103:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.230105:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789683651.231225:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789683651.231236:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a875f9dc/0xcf8485587b88aa95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.231249:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789683651.231254:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683651.231259:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a875f9dc/0xcf8485587b88aa95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.231272:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a875f9dc/0xcf8485587b88aa95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.231293:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a875f9dc/0xcf8485587b88aa95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.231300:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a875f9dc/0xcf8485587b88aa95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.231328:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683651.231556:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683651.231564:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a875f9dc/0xcf8485587b88aa95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.231573:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454dc00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683651.231577:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a875f9dc/0xcf8485587b88aa95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.231585:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a875f9dc/0xcf8485587b88aa95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.231599:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a875f9dc/0xcf8485587b88aa95 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.231606:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a875f9dc/0xcf8485587b88aa95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.231626:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683651.231628:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683651.231629:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789683651.231982:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789683651.231989:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8b5192f/0xcf8485587b88aa9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.231999:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789683651.232002:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683651.232007:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b5192f/0xcf8485587b88aa9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.232017:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8b5192f/0xcf8485587b88aa9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.232025:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8b5192f/0xcf8485587b88aa9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.232032:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b5192f/0xcf8485587b88aa9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.232066:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789683651.232089:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683651.232095:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8b5192f/0xcf8485587b88aa9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.232102:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454c200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683651.232106:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8b5192f/0xcf8485587b88aa9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.232114:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8b5192f/0xcf8485587b88aa9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.232125:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8b5192f/0xcf8485587b88aa9c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.232132:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8b5192f/0xcf8485587b88aa9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.232146:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.232148:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.232149:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789683651.233054:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789683651.233064:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5ed709b/0xcf8485587b88aaa3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.233076:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789683651.233080:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683651.233084:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5ed709b/0xcf8485587b88aaa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.233094:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5ed709b/0xcf8485587b88aaa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.233102:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5ed709b/0xcf8485587b88aaa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.233110:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5ed709b/0xcf8485587b88aaa3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683651.233128:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683651.233462:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683651.233468:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5ed709b/0xcf8485587b88aaa3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.233477:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454da00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683651.233481:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5ed709b/0xcf8485587b88aaa3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.233501:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5ed709b/0xcf8485587b88aaa3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.233517:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5ed709b/0xcf8485587b88aaa3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.233524:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5ed709b/0xcf8485587b88aaa3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.233544:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683651.233545:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683651.233547:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789683651.234033:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789683651.234040:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b88aaaa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.234049:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=565s v=(0 0) 00010000:00010000:1.0:1789683651.234052:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683651.234056:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b88aaaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.234065:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b88aaaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.234073:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b88aaaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.234090:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b88aaaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.234111:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789683651.234264:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683651.234270:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b88aaaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.234289:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837daa00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683651.234292:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b88aaaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.234300:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b88aaaa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.234310:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b88aaaa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.234316:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba8097a2/0xcf8485587b88aaaa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.234330:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.234332:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683651.234334:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683651.235872:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683651.235884:0:19141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88aab1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.236007:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=565s v=(0 0) 00010000:00010000:2.0:1789683651.236012:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683651.236018:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88aab1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.236031:0:19141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88aab1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.236050:0:19141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88aab1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.236058:0:19141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88aab1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683651.236076:0:19141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789683651.236141:0:19141:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1789683651.236243:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17225:x1876618850270208:12345-0@lo:5:osp-pre-0-0.0 Request processed in 64900us (64972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683651.236252:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789683651.236329:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683651.236336:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88aab1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.236343:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8e00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683651.236347:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88aab1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683651.236349:0:17225:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17225:1876618850270208:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789683651.236364:0:17225:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1789683651.236405:0:17225:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17225:1876618850270336:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1789683651.236428:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88aab1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.236454:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88aab1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683651.236455:0:17225:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683651.236461:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf6ad79e/0xcf8485587b88aab1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683651.236479:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683651.236481:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683651.236483:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683651.236489:0:17225:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9051b840 going to sleep for 11 seconds 00000100:00100000:2.0:1789683651.237494:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850270336 00000100:00100000:2.0:1789683651.237506:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850270336 00000100:00100000:2.0:1789683651.237563:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789683651.237572:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17225:x1876618850270336:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789683651.237614:0:18708:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:0.0:1789683651.250708:0:18704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1789683651.250767:0:18704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789683651.251003:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17225:x1876618850270336:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13427us (14543us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789683651.251014:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789683651.251172:0:17225:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1789683651.251182:0:17225:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17225:1876618850270336:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789683651.251198:0:17225:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000040:00080000:0.0:1789683651.874511:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789683652.129596:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789683652.767313:0:19523:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789683652.767317:0:19523:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789683652.767319:0:19523:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789683652.767494:0:19523:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0f8721b000 00000020:01000004:0.0:1789683652.767509:0:19523:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789683652.767524:0:19523:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789683652.767537:0:19523:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9f0fa719b380) 00000020:00000080:0.0:1789683652.767554:0:19523:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789683652.833222:0:19523:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789683652.834625:0:19523:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789683652.835011:0:19523:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789683652.835223:0:19523:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789683652.835439:0:19523:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789683652.835984:0:19523:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789683652.836285:0:19523:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1789683652.838309:0:19523:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789683652.838547:0:19523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789683652.838562:0:19523:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789683652.838574:0:19523:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf8485587b88aabf 00000020:01000004:3.0:1789683652.838580:0:19523:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789683652.838603:0:19523:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789683652.838606:0:19523:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789683652.838613:0:19523:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789683652.838654:0:19523:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789683652.838659:0:19523:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789683652.849127:0:19523:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789683652.849169:0:19523:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.150@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789683652.849173:0:19523:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789683652.849175:0:19523:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789683652.849177:0:19523:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683652.849178:0:19523:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683652.849179:0:19523:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683652.849180:0:19523:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683652.849186:0:19523:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683652.849189:0:19523:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683652.849190:0:19523:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789683652.849194:0:19523:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789683652.849196:0:19523:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789683652.849197:0:19523:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789683652.849198:0:19523:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683652.849199:0:19523:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683652.849200:0:19523:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683652.849201:0:19523:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683652.849201:0:19523:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683652.849202:0:19523:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683652.849203:0:19523:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789683652.849232:0:19523:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789683652.849255:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850270464:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789683652.849343:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683652.849447:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85730840 going to sleep for 11 seconds 00000100:00100000:3.0:1789683652.849496:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850270464 00000100:00100000:3.0:1789683652.849505:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850270464 00000100:00100000:3.0:1789683652.849593:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789683652.849603:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:19523:x1876618850270464:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789683652.849632:0:17195:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789683652.849636:0:17195:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789683652.849641:0:17195:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789683652.849991:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:19523:x1876618850270464:12345-0@lo:253:mount.lustre.0 Request processed in 389us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683652.850010:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789683652.850104:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850270464:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789683652.850117:0:19523:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789683652.850119:0:19523:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789683652.850120:0:19523:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789683652.850122:0:19523:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683652.850123:0:19523:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683652.850124:0:19523:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683652.850125:0:19523:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683652.850126:0:19523:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683652.850128:0:19523:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683652.850129:0:19523:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789683652.850147:0:19523:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0f8721b000 from lustre-OST0001 10000000:01000000:0.0:1789683652.850176:0:19523:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789683652.850179:0:19523:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789683652.850188:0:19523:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f0fb504b380 local copy 00010000:00010000:0.0:1789683652.850197:0:19523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a71c expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683652.850289:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850270592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683652.850319:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683652.850642:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83c83840 going to sleep for 11 seconds 00000100:00100000:2.0:1789683652.850731:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850270592 00000100:00100000:2.0:1789683652.850737:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850270592 00000100:00100000:2.0:1789683652.850763:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789683652.850770:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:19523:x1876618850270592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683652.850868:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:19523:x1876618850270592:12345-0@lo:501:mount.lustre.0 Request processed in 98us (548us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789683652.850885:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789683652.851050:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850270592:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789683652.851066:0:19523:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789683652.851084:0:19523:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789683652.851093:0:19523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a71c expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683652.851102:0:19523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177600/0xcf8485587b88a715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88a71c expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683652.851129:0:19523:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0f8721b000 10000000:01000000:0.0:1789683652.851133:0:19523:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789683652.851138:0:19523:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789683652.851141:0:19523:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789683652.851145:0:19523:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789683652.851147:0:19523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789683652.851171:0:19523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88aac6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683652.851178:0:19523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88aac6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683652.851187:0:19523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88aac6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683652.851217:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850270720:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789683652.851246:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683652.851274:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83c83840 going to sleep for 11 seconds 00000100:00100000:2.0:1789683652.851370:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850270720 00000100:00100000:2.0:1789683652.851376:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850270720 00000100:00100000:2.0:1789683652.851394:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789683652.851400:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:19523:x1876618850270720:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683652.851409:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683652.851431:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f8400/0xcf8485587b88aacd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88aac6 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683652.851463:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f8400/0xcf8485587b88aacd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88aac6 expref: 22 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683652.851473:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f8400/0xcf8485587b88aacd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88aac6 expref: 22 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683652.851482:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f8400, rc 0) 00000100:00100000:2.0:1789683652.851510:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:19523:x1876618850270720:12345-0@lo:101:mount.lustre.0 Request processed in 110us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683652.851516:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789683652.851654:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850270720:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683652.851666:0:19523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88aac6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88aacd expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683652.851675:0:19523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88aac6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88aacd expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789683652.852971:0:19523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789683652.854208:0:19523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683652.856670:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789683652.857153:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789683652.857177:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789683652.857193:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789683652.857209:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789683652.857223:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789683652.857250:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789683652.857256:0:19523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789683652.857680:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850270848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683652.858100:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683652.858176:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83c83900 going to sleep for 11 seconds 00000100:00100000:2.0:1789683652.858249:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850270848 00000100:00100000:2.0:1789683652.858256:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850270848 00000100:00100000:2.0:1789683652.858339:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789683652.858349:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:19523:x1876618850270848:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683652.858543:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:19523:x1876618850270848:12345-0@lo:501:mount.lustre.0 Request processed in 195us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683652.858551:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789683652.858627:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850270848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683652.858683:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f15f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850270976:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683652.858742:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683652.859321:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83612540 going to sleep for 11 seconds 00000100:00100000:0.0:1789683652.859423:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850270976 00000100:00100000:0.0:1789683652.859429:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850270976 00000100:00100000:0.0:1789683652.859465:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789683652.859474:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:19523:x1876618850270976:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683652.860689:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:19523:x1876618850270976:12345-0@lo:503:mount.lustre.0 Request processed in 1210us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683652.861075:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f15f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850270976:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683652.862098:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000040:00080000:1.0:1789683652.862561:0:19523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789683652.862676:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f15f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850271104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683652.863157:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683652.863190:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83612540 going to sleep for 11 seconds 00000100:00100000:3.0:1789683652.863279:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850271104 00000100:00100000:3.0:1789683652.863287:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850271104 00000100:00100000:3.0:1789683652.863388:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789683652.863398:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:19523:x1876618850271104:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683652.864221:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:19523:x1876618850271104:12345-0@lo:502:mount.lustre.0 Request processed in 823us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683652.864229:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789683652.864317:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f15f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850271104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789683652.864590:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789683652.864619:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789683652.864632:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789683652.864644:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789683652.864669:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789683652.864687:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789683652.864699:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789683652.864711:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789683652.864736:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789683652.864806:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f15f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850271232:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683652.864851:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683652.865513:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83612540 going to sleep for 11 seconds 00000100:00100000:2.0:1789683652.865564:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850271232 00000100:00100000:2.0:1789683652.865572:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850271232 00000100:00100000:2.0:1789683652.865607:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789683652.865615:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:19523:x1876618850271232:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683652.866231:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:19523:x1876618850271232:12345-0@lo:502:mount.lustre.0 Request processed in 614us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683652.866240:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789683652.866317:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f15f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850271232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789683652.866388:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789683652.866399:0:19523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1789683652.867553:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789683652.867563:0:19527:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789683652.867570:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683652.867573:0:19527:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789683652.867579:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789683652.867594:0:19527:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9f0fc04d99c0) 00000020:00000080:3.0:1789683652.867620:0:19527:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789683652.867625:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789683652.868243:0:19527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0f8721b000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789683652.868255:0:19527:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789683652.868262:0:19527:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf8485587b88aadb 00010000:00010000:2.0:1789683652.873558:0:19527:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1789683652.874610:0:19527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1789683652.877216:0:19527:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1789683652.879337:0:19527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789683652.879351:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683652.879357:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683652.879360:0:19527:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789683652.879364:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683652.879369:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683652.879370:0:19527:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789683652.879373:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789683652.879375:0:19527:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789683652.879377:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683652.879379:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683652.879380:0:19527:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789683652.879383:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683652.879385:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683652.879386:0:19527:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789683652.879389:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789683652.879432:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683652.879436:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683652.879437:0:19527:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789683652.879441:0:19527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1789683652.879622:0:19523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789683652.879655:0:19523:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789683652.879691:0:19523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88aac6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88aacd expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683652.879713:0:19523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f8454c000/0xcf8485587b88aac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88aacd expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683652.879722:0:19523:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0f8721b000 from 1 10000000:01000000:1.0:1789683652.879725:0:19523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789683652.879778:0:19523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837dba00/0xcf8485587b88aae2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683652.879808:0:19523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0e837dba00/0xcf8485587b88aae2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683652.879819:0:19523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0e837dba00/0xcf8485587b88aae2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683652.879844:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f15f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850271360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789683652.879924:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683652.879981:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83612540 going to sleep for 11 seconds 00000100:00100000:3.0:1789683652.880123:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850271360 00000100:00100000:3.0:1789683652.880131:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850271360 00000100:00100000:3.0:1789683652.880183:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789683652.880194:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:19523:x1876618850271360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683652.880207:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683652.880219:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81677200/0xcf8485587b88aae9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88aae2 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683652.880243:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81677200/0xcf8485587b88aae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88aae2 expref: 23 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683652.880263:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81677200/0xcf8485587b88aae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88aae2 expref: 23 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683652.880272:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81677200, rc 0) 00000100:00100000:3.0:1789683652.880316:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:19523:x1876618850271360:12345-0@lo:101:mount.lustre.0 Request processed in 124us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683652.880322:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789683652.880930:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f15f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850271360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683652.880946:0:19523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0e837dba00/0xcf8485587b88aae2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88aae9 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683652.880956:0:19523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0e837dba00/0xcf8485587b88aae2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88aae9 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789683652.882146:0:19523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789683652.882411:0:19523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683652.882633:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789683652.882665:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789683652.882683:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789683652.882689:0:19523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789683652.882753:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f15f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850271488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683652.883584:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683652.883666:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83612780 going to sleep for 11 seconds 00000100:00100000:2.0:1789683652.888474:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850271488 00000100:00100000:2.0:1789683652.888495:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850271488 00000100:00100000:2.0:1789683652.888562:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789683652.888572:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:19523:x1876618850271488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683652.889432:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:19523:x1876618850271488:12345-0@lo:501:mount.lustre.0 Request processed in 857us (5844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683652.889443:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789683652.889648:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f15f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850271488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683652.890113:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850271616:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683652.890180:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683652.890220:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c210c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683652.890272:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850271616 00000100:00100000:3.0:1789683652.890279:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850271616 00000100:00100000:3.0:1789683652.890323:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789683652.890332:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:19523:x1876618850271616:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789683652.890529:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:19523:x1876618850271616:12345-0@lo:503:mount.lustre.0 Request processed in 197us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683652.890537:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789683652.890609:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850271616:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789683652.891405:0:19523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789683652.891501:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850271744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683652.891558:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683652.891632:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c210c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683652.894566:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850271744 00000100:00100000:3.0:1789683652.894582:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850271744 00000100:00100000:3.0:1789683652.894690:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789683652.894711:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:19523:x1876618850271744:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683652.895143:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:19523:x1876618850271744:12345-0@lo:502:mount.lustre.0 Request processed in 433us (3583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683652.895151:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789683652.895287:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850271744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789683652.895531:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789683652.895562:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789683652.895575:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789683652.895587:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789683652.895600:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789683652.895629:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789683652.895647:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789683652.895660:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1789683652.895673:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789683652.895684:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1789683652.895711:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1789683652.895775:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850271872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683652.895854:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683652.896423:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8c210c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683652.896493:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850271872 00000100:00100000:2.0:1789683652.896501:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850271872 00000100:00100000:2.0:1789683652.896536:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789683652.896545:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:19523:x1876618850271872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683652.896680:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:19523:x1876618850271872:12345-0@lo:502:mount.lustre.0 Request processed in 136us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683652.896688:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789683652.896914:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850271872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789683652.896977:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1789683652.896989:0:19523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789683652.901230:0:19531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683652.901247:0:19531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683652.901250:0:19531:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789683652.901257:0:19531:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0f8721b000 00000020:00000080:0.0:1789683652.901260:0:19531:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789683652.901270:0:19531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683652.901272:0:19531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683652.901273:0:19531:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789683652.901276:0:19531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683652.901277:0:19531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683652.901278:0:19531:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789683652.901281:0:19531:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0f8721b000 00000020:00000080:0.0:1789683652.901283:0:19531:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789683652.901355:0:19531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683652.901359:0:19531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683652.901360:0:19531:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789683652.901363:0:19531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683652.901365:0:19531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683652.901366:0:19531:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789683652.901369:0:19531:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0f8721b000 00000020:00000080:0.0:1789683652.901372:0:19531:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789683652.901390:0:19531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683652.901392:0:19531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683652.901394:0:19531:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789683652.901396:0:19531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683652.901398:0:19531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683652.901399:0:19531:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789683652.901402:0:19531:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0f8721b000 00000020:00000080:0.0:1789683652.901404:0:19531:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789683652.901458:0:19531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683652.901462:0:19531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683652.901463:0:19531:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789683652.901466:0:19531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789683652.914532:0:19523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789683652.914593:0:19523:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683652.914618:0:19523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837dba00/0xcf8485587b88aae2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88aae9 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683652.914634:0:19523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0e837dba00/0xcf8485587b88aae2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88aae9 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683652.915398:0:19523:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789683652.915404:0:19523:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0f8721b000 10000000:01000000:2.0:1789683652.915407:0:19523:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0f8721b000 10000000:01000000:2.0:1789683652.915423:0:19523:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789683652.915430:0:19523:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0f8721b000 from 1 10000000:01000000:2.0:1789683652.915433:0:19523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789683652.915471:0:19523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88aaf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683652.915482:0:19523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88aaf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683652.915494:0:19523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88aaf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683652.915518:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850272000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789683652.915585:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683652.915623:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850272000 00000100:00100000:2.0:1789683652.915637:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850272000 00000100:00100000:2.0:1789683652.915683:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789683652.915693:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:19523:x1876618850272000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683652.919094:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683652.919122:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88aaf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88aaf0 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683652.919156:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88aaf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88aaf0 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683652.919168:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fa01f8e00/0xcf8485587b88aaf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88aaf0 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683652.919178:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f8e00, rc 0) 00000100:00100000:2.0:1789683652.919251:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:19523:x1876618850272000:12345-0@lo:101:mount.lustre.0 Request processed in 3557us (3663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683652.919260:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789683652.919350:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89dd2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789683652.919377:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850272000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683652.919397:0:19523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88aaf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88aaf7 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683652.919408:0:19523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88aaf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88aaf7 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789683652.925628:0:19523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1789683652.927491:0:19523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789683652.928347:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789683652.928385:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789683652.928422:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789683652.928441:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789683652.928473:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789683652.928487:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789683652.928498:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789683652.928511:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789683652.928522:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789683652.928532:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789683652.928544:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789683652.928555:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789683652.928573:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789683652.928585:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789683652.928596:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789683652.928608:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789683652.928620:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789683652.928632:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789683652.928644:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789683652.928657:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789683652.928683:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789683652.928711:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789683652.928736:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789683652.928750:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789683652.929562:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1789683652.929597:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1789683652.929610:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1789683652.929624:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1789683652.929636:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1789683652.929647:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1789683652.929659:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1789683652.929670:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1789683652.929683:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1789683652.929708:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1789683652.929735:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1789683652.929777:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1789683652.929831:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1789683652.929847:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1789683652.929860:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1789683652.929871:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1789683652.929970:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1789683652.929986:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1789683652.929999:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1789683652.930011:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1789683652.930024:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1789683652.930036:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1789683652.930059:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1789683652.930064:0:19523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1789683652.930182:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850272128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683652.930259:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683652.930312:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89dd29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683652.932660:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850272128 00000100:00100000:0.0:1789683652.932680:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850272128 00000100:00100000:0.0:1789683652.932746:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789683652.932757:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:19523:x1876618850272128:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683652.932989:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:19523:x1876618850272128:12345-0@lo:501:mount.lustre.0 Request processed in 233us (2729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683652.932998:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789683652.933055:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850272128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683652.933106:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850272256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683652.933159:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683652.933185:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e929c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683652.933377:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850272256 00000100:00100000:2.0:1789683652.933383:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850272256 00000100:00100000:2.0:1789683652.933430:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789683652.933438:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:19523:x1876618850272256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789683652.933524:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:19523:x1876618850272256:12345-0@lo:503:mount.lustre.0 Request processed in 87us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683652.933531:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789683652.934167:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850272256:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789683652.934645:0:19523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789683652.934756:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850272384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683652.935179:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683652.935207:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e929c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683652.935324:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850272384 00000100:00100000:2.0:1789683652.935331:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850272384 00000100:00100000:2.0:1789683652.935370:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789683652.935378:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:19523:x1876618850272384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683652.935498:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:19523:x1876618850272384:12345-0@lo:502:mount.lustre.0 Request processed in 120us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683652.935515:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789683652.935615:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850272384:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789683652.936186:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789683652.936218:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789683652.936232:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789683652.936245:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789683652.936259:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789683652.936272:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789683652.936298:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789683652.936314:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789683652.936328:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789683652.936340:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789683652.936353:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789683652.936366:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789683652.936380:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789683652.936393:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789683652.936407:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789683652.939093:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789683652.939142:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789683652.939160:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789683652.939174:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789683652.939187:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789683652.939200:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789683652.939214:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789683652.939225:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789683652.939240:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789683652.939253:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1789683652.939264:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1789683652.939278:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1789683652.939291:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1789683652.939304:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1789683652.939316:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1789683652.939328:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1789683652.939341:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1789683652.939367:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1789683652.939382:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1789683652.939396:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1789683652.939409:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1789683652.939435:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1789683652.939449:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1789683652.939462:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1789683652.939484:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1789683652.939496:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1789683652.939507:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1789683652.939520:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1789683652.939532:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1789683652.939545:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1789683652.939558:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1789683652.939570:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1789683652.939583:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1789683652.939652:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850272512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683652.939740:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683652.941074:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850272512 00000100:00100000:2.0:1789683652.941087:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850272512 00000100:00100000:2.0:1789683652.941162:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789683652.941173:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:19523:x1876618850272512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683652.941486:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f92e929c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683652.945235:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:19523:x1876618850272512:12345-0@lo:502:mount.lustre.0 Request processed in 4053us (5484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683652.945252:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789683652.945424:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850272512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789683652.945685:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789683652.945738:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789683652.945998:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850272640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683652.946048:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683652.946082:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f83612c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683652.948912:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850272640 00000100:00100000:2.0:1789683652.948929:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850272640 00000100:00100000:2.0:1789683652.948998:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789683652.949009:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:19523:x1876618850272640:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683652.949154:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:19523:x1876618850272640:12345-0@lo:502:mount.lustre.0 Request processed in 148us (3105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683652.949162:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789683652.949355:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850272640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789683652.949444:0:19523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1789683652.949458:0:19523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789683652.952225:0:19536:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789683652.952246:0:19536:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9f0e83c28000) 00000020:00000080:1.0:1789683652.952275:0:19536:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1789683652.952388:0:19536:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0f8721b000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789683652.952392:0:19536:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0f8721b000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789683652.952395:0:19536:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0f8721b000 3 00010000:00080000:1.0:1789683652.952439:0:19536:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0e82e44000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.150@tcp at head 00010000:00010000:1.0:1789683652.955870:0:19536:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1789683652.956086:0:19536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789683652.956138:0:19536:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789683652.956155:0:19536:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcf8485587b88ab05 00000100:00080000:1.0:1789683652.956170:0:19536:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789683652.956185:0:19536:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f0e82e44000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789683652.956243:0:19536:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0e83f15880 x1876618850272768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683652.956269:0:19536:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789683652.957616:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1876618850272768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789683652.957712:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789683652.957843:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683652.957847:0:14530:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789683652.957854:0:14530:0:(import.c:65:import_set_state_nolock()) ffff9f0fb240d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683652.957859:0:14530:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 565 00000100:00080000:3.0:1789683652.957863:0:14530:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789683652.957872:0:14530:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0fb240d000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683652.957892:0:14530:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc0725f80 x1876618850273280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683652.957924:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683652.957927:0:14530:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789683652.957929:0:14530:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdbd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683652.957932:0:14530:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 565 00000100:00080000:3.0:1789683652.957934:0:14530:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789683652.957938:0:14530:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0f8bdbd000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789683652.957950:0:14530:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fc0725500 x1876618850273792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789683652.958004:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850272768 00000100:00100000:3.0:1789683652.958011:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850272768 00000100:00100000:3.0:1789683652.958043:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683652.958050:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876618850272768:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789683652.958073:0:17200:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:3.0:1789683652.958106:0:17200:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcf8485587b88ab0c 00000004:00100000:3.0:1789683652.958121:0:17200:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789683652.958150:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9f0f8a2c7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683652.958195:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876618850272768:12345-0@lo:38:llog_process_th.0 Request processed in 144us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683652.958202:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683652.958230:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3648:1876618850272896:0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.958259:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683652.958280:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850273536:0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.958317:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683652.958334:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850274176:0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.958352:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683652.958369:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789683652.958373:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850273408:0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.958398:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683652.960130:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850274048:0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.960198:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683652.960253:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850273024:0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.960280:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683652.960298:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850273664:0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.960321:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683652.960351:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789683652.960359:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850273152:0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.960382:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683652.960424:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850273920:0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.960447:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683652.960477:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850273280:0@lo:8:kworker.0 00000100:00100000:3.0:1789683652.960502:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683652.960521:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850273792:0@lo:8:kworker.0 00000100:00100000:3.0:1789683652.960541:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789683652.960596:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0e83f15880 x1876618850272768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683652.960610:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789683652.960621:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789683652.960630:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789683652.960635:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789683652.960638:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e82e44000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789683652.960645:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1876618850272768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789683652.960678:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850274176 00000100:00100000:3.0:1789683652.960685:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850274176 00000100:00100000:3.0:1789683652.960732:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850273408 00000100:00100000:3.0:1789683652.960736:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850273408 00000100:00100000:3.0:1789683652.960749:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850274048 00000100:00100000:3.0:1789683652.960751:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850274048 00000100:00100000:3.0:1789683652.960762:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850273920 00000100:00100000:3.0:1789683652.960765:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850273920 00000100:00100000:3.0:1789683652.960779:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789683652.960809:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850274176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.960864:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850274176:12345-0@lo:400:kworker.0 Request processed in 57us (2510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683652.960872:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789683652.960887:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789683652.960893:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850273408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.960921:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850273408:12345-0@lo:400:kworker.0 Request processed in 29us (2522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683652.960928:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789683652.960938:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789683652.960954:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850274048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.960984:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850274048:12345-0@lo:400:kworker.0 Request processed in 31us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683652.960989:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789683652.961001:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789683652.961007:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850273920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.961055:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876618850273920:12345-0@lo:400:kworker.0 Request processed in 48us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683652.961062:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789683652.961081:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850273536 00000100:00100000:3.0:1789683652.961085:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850273536 00000100:00100000:3.0:1789683652.961109:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850273024 00000100:00100000:3.0:1789683652.961112:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850273024 00000100:00100000:3.0:1789683652.961123:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789683652.961128:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850273536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.961159:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850273536:12345-0@lo:400:kworker.0 Request processed in 31us (2841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683652.961165:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789683652.961176:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789683652.961181:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850273024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.961202:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850273024:12345-0@lo:400:kworker.0 Request processed in 22us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683652.961207:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789683652.961236:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850273664 00000100:00100000:3.0:1789683652.961240:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850273664 00000100:00100000:3.0:1789683652.961259:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850273152 00000100:00100000:3.0:1789683652.961262:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850273152 00000100:00100000:3.0:1789683652.961278:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850273280 00000100:00100000:3.0:1789683652.961281:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850273280 00000100:00100000:3.0:1789683652.961287:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850273792 00000100:00100000:3.0:1789683652.961290:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850273792 00000100:00100000:3.0:1789683652.961298:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683652.961303:0:18709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850273664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.961337:0:18709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850273664:12345-0@lo:400:kworker.0 Request processed in 34us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683652.961343:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683652.961354:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789683652.961360:0:18709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850273152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.961385:0:18709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850273152:12345-0@lo:400:kworker.0 Request processed in 25us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683652.961390:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789683652.961401:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683652.961405:0:18709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1876618850273280:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789683652.961469:0:18709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1876618850273280:12345-0@lo:8:kworker.0 Request processed in 63us (966us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789683652.961475:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683652.961487:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789683652.961491:0:18709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1876618850273792:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789683652.961520:0:18709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1876618850273792:12345-0@lo:8:kworker.0 Request processed in 27us (978us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789683652.961525:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789683652.961547:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789683652.961552:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683652.961554:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789683652.961578:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc0724700 x1876618850273408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683652.961598:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850273408:0@lo:400:kworker.0 00010000:00080000:3.0:1789683652.961614:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc0726d80 x1876618850274048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683652.961622:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850274048:0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.961633:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850273536:0@lo:400:kworker.0 00010000:00080000:3.0:1789683652.961643:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc0726680 x1876618850274176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683652.961651:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850274176:0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.961692:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850273152:0@lo:400:kworker.0 00010000:00080000:3.0:1789683652.961703:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fc0727800 x1876618850273920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683652.961711:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876618850273920:0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.961720:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850273024:0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.961732:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850273664:0@lo:400:kworker.0 00000100:00100000:3.0:1789683652.961761:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789683652.961766:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb240d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683652.961770:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789683652.961773:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850273280:0@lo:8:kworker.0 00000100:00100000:3.0:1789683652.961781:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789683652.961807:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdbd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683652.961818:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789683652.961821:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850273792:0@lo:8:kworker.0 00000020:01000004:1.0:1789683652.966229:0:19536:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789683652.966254:0:19536:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9f0f861819c0) 00000020:00000080:1.0:1789683652.966284:0:19536:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1789683652.966396:0:19536:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0f8721b000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789683652.966400:0:19536:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0f8721b000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789683652.966403:0:19536:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0f8721b000 3 00010000:00080000:1.0:1789683652.966448:0:19536:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0e82e43000@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.150@tcp at head 00000100:00100000:2.0:1789683652.968030:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850272896 00000100:00100000:2.0:1789683652.968042:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850272896 00000100:00100000:2.0:1789683652.968098:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789683652.968110:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8652d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3648:x1876618850272896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683652.968211:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8652d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3648:x1876618850272896:12345-0@lo:400:kworker.0 Request processed in 103us (9950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683652.968218:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789683652.968444:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3648:1876618850272896:0@lo:400:kworker.0 00010000:00010000:2.0:1789683652.972695:0:19536:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1789683652.976261:0:19536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789683652.976314:0:19536:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789683652.976328:0:19536:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xcf8485587b88ab1a 00000100:00080000:2.0:1789683652.976347:0:19536:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789683652.976359:0:19536:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f0e82e43000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789683652.976398:0:19536:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fa7245880 x1876618850274304/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789683652.976432:0:19536:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789683652.976943:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1876618850274304:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789683652.977013:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683652.977066:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850274304 00000100:00100000:3.0:1789683652.977073:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850274304 00000100:00100000:3.0:1789683652.977105:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683652.977112:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1876618850274304:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789683652.977139:0:18733:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:3.0:1789683652.977190:0:18733:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xcf8485587b88ab21 00000004:00100000:3.0:1789683652.977205:0:18733:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789683652.977235:0:18733:0:(import.c:65:import_set_state_nolock()) ffff9f0e82539800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683652.977285:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876618850274304:12345-0@lo:38:llog_process_th.0 Request processed in 171us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683652.977292:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789683652.977330:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0fa7245880 x1876618850274304/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683652.977340:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789683652.977349:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789683652.977356:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789683652.977359:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789683652.977361:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0e82e43000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789683652.977366:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1876618850274304:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789683652.979176:0:19536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1789683652.979263:0:19523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789683652.979299:0:19523:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789683652.979322:0:19523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88aaf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88aaf7 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683652.979334:0:19523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fa01f9000/0xcf8485587b88aaf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88aaf7 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789683652.981555:0:19523:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789683652.981566:0:19523:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789683652.981568:0:19523:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683652.981569:0:19523:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683652.981571:0:19523:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683652.981574:0:19523:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683652.981575:0:19523:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789683652.981577:0:19523:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683652.981578:0:19523:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789683652.981583:0:19523:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789683652.981586:0:19523:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789683652.981588:0:19523:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789683652.981589:0:19523:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683652.981590:0:19523:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683652.981591:0:19523:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683652.981592:0:19523:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683652.981593:0:19523:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789683652.981594:0:19523:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683652.981595:0:19523:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789683652.981817:0:19523:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789683652.981841:0:19523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850274432:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789683652.982079:0:19523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683652.982127:0:19523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e83c83000 going to sleep for 11 seconds 00000100:00100000:0.0:1789683652.982179:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850274432 00000100:00100000:0.0:1789683652.982188:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850274432 00000100:00100000:0.0:1789683652.982245:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789683652.982254:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8652ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:19523:x1876618850274432:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789683652.982283:0:17194:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789683652.982298:0:17194:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789683652.997872:0:17194:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789683652.997892:0:17194:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789683652.998182:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8652ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:19523:x1876618850274432:12345-0@lo:253:mount.lustre.0 Request processed in 15923us (16097us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683652.998196:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789683652.998265:0:19523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:19523:1876618850274432:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789683652.998280:0:19523:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789683652.998284:0:19523:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789683652.998285:0:19523:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789683652.998287:0:19523:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683652.998295:0:19523:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683652.998297:0:19523:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683652.998298:0:19523:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683652.998299:0:19523:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683652.998301:0:19523:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683652.998303:0:19523:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789683652.998318:0:19523:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1789683652.999001:0:17216:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789683652.999007:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789683652.999027:0:17216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88ab28 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683652.999042:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0e837db400/0xcf8485587b88a9d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a9d1 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683652.999050:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b88a9e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a9df expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683652.999067:0:17216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88ab28 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683652.999101:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b88a9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88a9df expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683652.999114:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b88a9e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88a9df expref: 23 pid: 17193 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683652.999126:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1876618850274560:0@lo:104: 00000100:00100000:3.0:1789683652.999163:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789683652.999245:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0e837db400/0xcf8485587b88a9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88a9d1 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683652.999252:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0e837db400/0xcf8485587b88a9d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88a9d1 expref: 23 pid: 17193 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683652.999261:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7963800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1876618850274688:0@lo:104: 00000100:00100000:3.0:1789683652.999281:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683652.999694:0:17216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683653.000971:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850274560 00000100:00100000:0.0:1789683653.000981:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850274560 00000100:00100000:1.0:1789683653.001132:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850274688 00000100:00100000:1.0:1789683653.001137:0:17183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850274688 00000100:00100000:1.0:1789683653.001164:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789683653.001173:0:17183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+4:17216:x1876618850274560:12345-0@lo:104: 00010000:00010000:1.0:1789683653.001190:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a9e6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683653.001264:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683653.001270:0:17183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+4:17216:x1876618850274560:12345-0@lo:104: Request processed in 99us (2107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683653.001277:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789683653.001292:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789683653.001298:0:17183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+3:17216:x1876618850274688:12345-0@lo:104: 00010000:00010000:1.0:1789683653.001305:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176600/0xcf8485587b88a9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a9d8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683653.001333:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789683653.001338:0:17183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+3:17216:x1876618850274688:12345-0@lo:104: Request processed in 41us (2057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683653.001350:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789683653.001367:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683653.001373:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a9e6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683653.001381:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177400 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683653.001385:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88a9e6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683653.001394:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a9df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88a9e6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683653.001401:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a9df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88a9e6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683653.001420:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789683653.001464:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a9df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a9e6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683653.001470:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683653.001488:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a9df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a9e6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683653.001495:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177400/0xcf8485587b88a9df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a9e6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683653.001505:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683653.001508:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176600/0xcf8485587b88a9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a9d8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683653.001524:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176600 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:1.0:1789683653.001527:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176600/0xcf8485587b88a9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88a9d8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683653.001534:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176600/0xcf8485587b88a9d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88a9d8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683653.001540:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176600/0xcf8485587b88a9d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88a9d8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683653.001544:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789683653.001560:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176600/0xcf8485587b88a9d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a9d8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683653.001564:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683653.001571:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176600/0xcf8485587b88a9d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a9d8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683653.001577:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176600/0xcf8485587b88a9d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a9d8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683653.001590:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683653.001592:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683653.001593:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683653.001600:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683653.002804:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850274944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683653.002867:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683653.002915:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683653.002922:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850274816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683653.002943:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683653.002999:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1876618850274560:0@lo:104: 00000100:00100000:3.0:1789683653.003010:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7963800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1876618850274688:0@lo:104: 00010000:00010000:3.0:1789683653.003040:0:17216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88ab28 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683653.003550:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850274944 00000100:00100000:2.0:1789683653.003558:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850274944 00010000:00010000:2.0:1789683653.003586:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0e837db400/0xcf8485587b88a9d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a9d1 expref: 24 pid: 17193 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683653.003621:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850274816 00000100:00100000:2.0:1789683653.003624:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850274816 00010000:00010000:2.0:1789683653.003638:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b88a9e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a9df expref: 25 pid: 17193 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683653.003653:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789683653.003661:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+25:3650:x1876618850274944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683653.003675:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683653.003680:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0e837db400/0xcf8485587b88a9d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a9d1 expref: 25 pid: 17193 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683653.003690:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0e837db400/0xcf8485587b88a9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88a9d1 expref: 25 pid: 17193 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683653.003720:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0e837db400/0xcf8485587b88a9d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88a9d1 expref: 25 pid: 17193 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683653.003733:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683653.003774:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3650:x1876618850274944:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683653.003781:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789683653.003820:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789683653.003827:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:3650:x1876618850274816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683653.003836:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683653.003840:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b88a9e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a9df expref: 23 pid: 17193 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683653.003849:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b88a9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88a9df expref: 23 pid: 17193 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683653.003859:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f9600/0xcf8485587b88a9e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88a9df expref: 23 pid: 17193 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683653.003870:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88ab28 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683653.003879:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88ab28 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789683653.003897:0:17186:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009891571s 00010000:00010000:2.0:1789683653.003902:0:17186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88ab28 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683653.003918:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88ab28 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683653.003925:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88ab28 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683653.003933:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88ab28 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683653.003940:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81676e00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683653.003944:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88ab28 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683653.003951:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88ab28 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683653.003963:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88ab28 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683653.003972:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683653.003998:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:3650:x1876618850274816:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683653.004004:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:00000004:2.0:1789683653.004208:0:19523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1789683653.004363:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850274816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683653.004373:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850274944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683653.004398:0:17216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88ab28 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683653.004405:0:17216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88ab28 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683653.004420:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81676e00/0xcf8485587b88ab28 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789683653.009756:0:19523:0:(ofd_obd.c:547:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789683653.009766:0:19523:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789683653.009840:0:19523:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789683653.009901:0:19523:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789683653.009921:0:19523:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1789683653.009952:0:19523:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1789683653.010757:0:19523:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789683653.011020:0:19523:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789683653.152757:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789683654.107011:0:19590:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789683654.107279:0:19590:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789683654.178176:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789683654.819741:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789683654.819750:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0fc04cf800 from 10 10000000:01000000:3.0:1789683654.819756:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789683654.819839:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81676e00/0xcf8485587b88ab2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683654.819986:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f81676e00/0xcf8485587b88ab2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683654.820002:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f81676e00/0xcf8485587b88ab2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683654.820038:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7963800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850275072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789683654.820128:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683654.820185:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17240 going to sleep for 11 seconds 00000100:00100000:3.0:1789683654.820225:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850275072 00000100:00100000:3.0:1789683654.820236:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850275072 00000100:00100000:3.0:1789683654.820299:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789683654.820310:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8652fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:17197:x1876618850275072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683654.820326:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683654.820347:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81676200/0xcf8485587b88ab36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88ab2f expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683654.820392:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81676200/0xcf8485587b88ab36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88ab2f expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683654.820405:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81676200/0xcf8485587b88ab36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88ab2f expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683654.820414:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81676200, rc 0) 00000100:00100000:3.0:1789683654.820456:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8652fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:17197:x1876618850275072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683654.820463:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789683654.820513:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7963800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850275072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683654.820528:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f81676e00/0xcf8485587b88ab2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88ab36 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683654.820537:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f81676e00/0xcf8485587b88ab2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88ab36 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683654.820586:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7963800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850275200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789683654.820622:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683654.820635:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17240 going to sleep for 11 seconds 00000100:00100000:0.0:1789683654.820879:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850275200 00000100:00100000:0.0:1789683654.820884:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850275200 00000100:00100000:0.0:1789683654.820910:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789683654.820918:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8f78f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:17197:x1876618850275200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789683654.820932:0:17194:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789683654.820950:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789683654.820954:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1789683654.821034:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8f78f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:17197:x1876618850275200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683654.821041:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789683654.822984:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7963800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850275200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789683654.823091:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789683654.823104:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81676e00/0xcf8485587b88ab2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88ab36 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683654.823116:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f81676e00/0xcf8485587b88ab2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88ab36 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683654.823128:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789683654.823131:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0e83ec0800 from 10 10000000:01000000:3.0:1789683654.823133:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789683654.823171:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81677a00/0xcf8485587b88ab3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683654.823180:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0f81677a00/0xcf8485587b88ab3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683654.823189:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0f81677a00/0xcf8485587b88ab3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683654.823210:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7963800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850275328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789683654.823268:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683654.823319:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17240 going to sleep for 11 seconds 00000100:00100000:0.0:1789683654.825020:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850275328 00000100:00100000:0.0:1789683654.825034:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850275328 00000100:00100000:0.0:1789683654.825094:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789683654.825104:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8f78fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:17197:x1876618850275328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683654.825120:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683654.825139:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454d800/0xcf8485587b88ab44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88ab3d expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683654.825167:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454d800/0xcf8485587b88ab44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88ab3d expref: 24 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683654.825179:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454d800/0xcf8485587b88ab44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88ab3d expref: 24 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683654.825201:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d800, rc 0) 00000100:00100000:0.0:1789683654.825269:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8f78fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:17197:x1876618850275328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (2000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683654.825276:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789683654.827639:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7963800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850275328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683654.827674:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0f81677a00/0xcf8485587b88ab3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88ab44 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683654.827688:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0f81677a00/0xcf8485587b88ab3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88ab44 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683654.827779:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7963800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850275456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789683654.827955:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683654.828001:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0e82d17240 going to sleep for 11 seconds 00000100:00100000:0.0:1789683654.828254:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850275456 00000100:00100000:0.0:1789683654.828263:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850275456 00000100:00100000:0.0:1789683654.828316:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789683654.828325:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc037b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:17197:x1876618850275456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789683654.828350:0:17193:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789683654.828371:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789683654.828375:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1789683654.828498:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc037b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:17197:x1876618850275456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 172us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683654.828506:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789683654.829016:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7963800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850275456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789683654.829082:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789683654.829092:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0f81677a00/0xcf8485587b88ab3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88ab44 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683654.829101:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0f81677a00/0xcf8485587b88ab3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88ab44 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683655.206072:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683655.263151:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683655.263178:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850275584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683655.263264:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683655.263312:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850275584 00000100:00100000:0.0:1789683655.263320:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850275584 00000100:00100000:0.0:1789683655.263380:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789683655.263391:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850275584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789683655.263427:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789683655.263480:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850275584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683655.263488:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789683655.263555:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850275584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789683655.276182:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683655.276210:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850275712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789683655.276286:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683655.276335:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850275712 00000100:00100000:2.0:1789683655.276343:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850275712 00000100:00100000:2.0:1789683655.276426:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789683655.276434:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850275712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789683655.276473:0:17941:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789683655.276523:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850275712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683655.276530:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789683655.276581:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850275712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683655.277381:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683655.277394:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850275840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683655.277443:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683655.277627:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850275840 00000100:00100000:1.0:1789683655.277635:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850275840 00000100:00100000:1.0:1789683655.277708:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683655.277719:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850275840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789683655.277745:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789683655.277821:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850275840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683655.277828:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789683655.277987:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683655.278065:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850275840:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789683656.237145:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683656.292779:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850275968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683656.292884:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683656.293466:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850275968 00000100:00100000:0.0:1789683656.293477:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850275968 00000100:00100000:0.0:1789683656.293554:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789683656.293563:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850275968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683656.293588:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789683656.293645:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850275968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683656.293651:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789683656.293715:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683656.293758:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850275968:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789683656.737156:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789683657.250462:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683658.271091:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683658.339963:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850276096:0@lo:400:kworker.0 00000100:00100000:2.0:1789683658.340044:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683658.340149:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850276096 00000100:00100000:3.0:1789683658.340158:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850276096 00000100:00100000:3.0:1789683658.340212:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789683658.340223:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3647:x1876618850276096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683658.340452:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850276224:0@lo:400:kworker.0 00000100:00100000:1.0:1789683658.340484:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683658.340524:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850276224 00000100:00100000:1.0:1789683658.340528:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850276224 00000100:00100000:1.0:1789683658.340557:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789683658.340563:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850276224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683658.340600:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850276224:12345-0@lo:400:kworker.0 Request processed in 37us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683658.340608:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789683658.340647:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850276224:0@lo:400:kworker.0 00000100:00100000:3.0:1789683658.340719:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3647:x1876618850276096:12345-0@lo:400:kworker.0 Request processed in 497us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683658.340727:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1789683658.344553:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789683658.344561:0:14530:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789683658.344566:0:14530:0:(import.c:65:import_set_state_nolock()) ffff9f0fb240d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789683658.344585:0:14530:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0fb240d000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789683658.344607:0:14530:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb79b5c00 x1876618850276480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789683658.344644:0:14530:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789683658.344647:0:14530:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789683658.344649:0:14530:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdbd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789683658.344653:0:14530:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0f8bdbd000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789683658.344671:0:14530:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0fb79b4700 x1876618850276992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789683658.344727:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850276608:0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.344815:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683658.344846:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850277248:0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.344865:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683658.344886:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789683658.344891:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850276352:0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.344914:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683658.344932:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850277120:0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.344950:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683658.344964:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850277632:0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.344987:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683658.345012:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850276480:0@lo:8:kworker.0 00000100:00100000:0.0:1789683658.345035:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683658.345051:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850276992:0@lo:8:kworker.0 00000100:00100000:0.0:1789683658.345070:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683658.345100:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850276608 00000100:00100000:0.0:1789683658.345106:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850276608 00000100:00100000:0.0:1789683658.345140:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850277248 00000100:00100000:0.0:1789683658.345142:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850277248 00000100:00100000:0.0:1789683658.345165:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850277120 00000100:00100000:0.0:1789683658.345167:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850277120 00000100:00100000:0.0:1789683658.345176:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850277632 00000100:00100000:0.0:1789683658.345178:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850277632 00000100:00100000:0.0:1789683658.345192:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789683658.345199:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850276608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.345249:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850276608:12345-0@lo:400:kworker.0 Request processed in 51us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683658.345256:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789683658.345271:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789683658.345276:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850277248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.345295:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850277248:12345-0@lo:400:kworker.0 Request processed in 20us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683658.345300:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789683658.345308:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789683658.345313:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850277120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.345345:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850277120:12345-0@lo:400:kworker.0 Request processed in 32us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683658.345350:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789683658.345359:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789683658.345364:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850277632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.345383:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850277632:12345-0@lo:400:kworker.0 Request processed in 19us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683658.345388:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789683658.345405:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850276352 00000100:00100000:0.0:1789683658.345407:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850276352 00000100:00100000:0.0:1789683658.345428:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850276480 00000100:00100000:0.0:1789683658.345430:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850276480 00000100:00100000:0.0:1789683658.345437:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850276992 00000100:00100000:0.0:1789683658.345438:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850276992 00000100:00100000:0.0:1789683658.345445:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789683658.345450:0:18709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850276352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.345482:0:18709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850276352:12345-0@lo:400:kworker.0 Request processed in 32us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683658.345488:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789683658.345497:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789683658.345501:0:18709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1876618850276480:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789683658.345524:0:18709:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 572 last 0 00000020:00000080:0.0:1789683658.345552:0:18709:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf8485587b88ab4b 00002000:00100000:0.0:1789683658.345567:0:18709:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9f0e825e2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789683658.345571:0:18709:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789683658.345574:0:18709:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789683658.345733:0:18709:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789683658.345755:0:18709:0:(import.c:65:import_set_state_nolock()) ffff9f0e825e1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683658.345804:0:18709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876618850276480:12345-0@lo:8:kworker.0 Request processed in 281us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683658.345810:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789683658.345821:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789683658.345825:0:18709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1876618850276992:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789683658.345852:0:18709:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 572 last 0 00000020:00000080:0.0:1789683658.345867:0:18709:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf8485587b88ab52 00002000:00100000:0.0:1789683658.345873:0:18709:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9f0e825e4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789683658.345876:0:18709:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1789683658.345878:0:18709:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789683658.345898:0:18709:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789683658.345910:0:18709:0:(import.c:65:import_set_state_nolock()) ffff9f0e825e3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683658.345937:0:18709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1876618850276992:12345-0@lo:8:kworker.0 Request processed in 110us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683658.345948:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789683658.345980:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683658.345984:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683658.345986:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683658.346017:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850276352:0@lo:400:kworker.0 00010000:00080000:0.0:1789683658.346028:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb79b5500 x1876618850277120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683658.346037:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850277120:0@lo:400:kworker.0 00010000:00080000:0.0:1789683658.346045:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7998e00 x1876618850277632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683658.346052:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850277632:0@lo:400:kworker.0 00010000:00080000:0.0:1789683658.346060:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb79b7800 x1876618850276608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683658.346067:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850276608:0@lo:400:kworker.0 00010000:00080000:0.0:1789683658.346075:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb79b6a00 x1876618850277248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683658.346082:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850277248:0@lo:400:kworker.0 00010000:00080000:0.0:1789683658.346110:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb79b5c00 x1876618850276480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789683683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789683658.346120:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789683658.346126:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789683658.346130:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789683658.346132:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0fb240d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789683658.346146:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789683658.346151:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1876618850276480:0@lo:8:kworker.0 00010000:00080000:0.0:1789683658.346163:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb79b4700 x1876618850276992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789683683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789683658.346171:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789683658.346176:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789683658.346178:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789683658.346180:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f0f8bdbd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789683658.346200:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789683658.346203:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1876618850276992:0@lo:8:kworker.0 00000100:00100000:0.0:1789683658.346221:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850276864:0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.346245:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683658.346261:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850277504:0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.346280:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683658.346292:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789683658.346297:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850276736:0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.346313:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683658.346343:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850277376:0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.346360:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683658.346379:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850277504 00000100:00100000:0.0:1789683658.346383:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850277504 00000100:00100000:0.0:1789683658.346406:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850277376 00000100:00100000:0.0:1789683658.346408:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850277376 00000100:00100000:0.0:1789683658.346421:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789683658.346426:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850277504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.346456:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876618850277504:12345-0@lo:400:kworker.0 Request processed in 30us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683658.346466:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789683658.346479:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789683658.346483:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850277376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.346505:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850277376:12345-0@lo:400:kworker.0 Request processed in 22us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683658.346510:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1789683658.346523:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789683658.346526:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789683658.346538:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7998700 x1876618850277376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683658.346546:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850277376:0@lo:400:kworker.0 00010000:00080000:0.0:1789683658.346554:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7999180 x1876618850277504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683658.346561:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1876618850277504:0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.346576:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850276864 00000100:00100000:0.0:1789683658.346579:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850276864 00000100:00100000:0.0:1789683658.346599:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789683658.346604:0:18709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850276864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.346628:0:18709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850276864:12345-0@lo:400:kworker.0 Request processed in 24us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683658.346633:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789683658.346644:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683658.346654:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850276864:0@lo:400:kworker.0 00000004:00080000:1.0:1789683658.346869:0:17227:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1789683658.346885:0:17227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f14380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17227:1876618850277888:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789683658.346920:0:17227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683658.346937:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc151f0c0 going to sleep for 11 seconds 00000004:00080000:1.0:1789683658.346953:0:17226:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789683658.347030:0:17226:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572396245032ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789683658.347036:0:17226:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789683658.347206:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683658.347216:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850277760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683658.347243:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683658.347269:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850277760 00000100:00100000:1.0:1789683658.347273:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850277760 00000100:00100000:1.0:1789683658.347302:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683658.347309:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1876618850277760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789683658.347342:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789683658.347377:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1876618850277760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683658.347382:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683658.347401:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850277888 00000100:00100000:1.0:1789683658.347404:0:18710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850277888 00000100:00100000:1.0:1789683658.347422:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789683658.347427:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17227:x1876618850277888:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1789683658.347608:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789683658.347633:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83f16300 x1876618850277760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683658.347650:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850277760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683658.347691:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850276736 00000100:00100000:1.0:1789683658.347696:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850276736 00000100:00100000:1.0:1789683658.347723:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789683658.347735:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850276736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683658.347771:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850276736:12345-0@lo:400:kworker.0 Request processed in 38us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683658.347777:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:1.0:1789683658.347838:0:17945:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789683658.347852:0:17945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f16d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17945:1876618850278144:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1789683658.347876:0:17945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683658.347889:0:17945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc151fcc0 going to sleep for 11 seconds 00000004:00080000:1.0:1789683658.347914:0:17944:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789683658.347969:0:17944:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 572397185035ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789683658.347975:0:17944:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789683658.349936:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850276736:0@lo:400:kworker.0 00000100:00100000:0.0:1789683658.349969:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683658.349981:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850278016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789683658.350036:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683658.350081:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850278016 00000100:00100000:0.0:1789683658.350088:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850278016 00000100:00100000:0.0:1789683658.350138:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789683658.350146:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1876618850278016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789683658.350171:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789683658.350216:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1876618850278016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683658.350224:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789683658.350246:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789683658.350266:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83f16300 x1876618850278016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683658.350283:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850278016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789683658.350302:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850278144 00000100:00100000:0.0:1789683658.350306:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850278144 00000004:00080000:1.0:1789683658.350663:0:17180:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:1.0:1789683658.350690:0:18710:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789683658.350695:0:18710:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789683658.350700:0:18710:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000100:00100000:0.0:1789683658.351400:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789683658.351414:0:18709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17945:x1876618850278144:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1789683658.352083:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850276096:0@lo:400:kworker.0 00002000:00080000:0.0:1789683658.357219:0:18709:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789683658.357229:0:18709:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789683658.357374:0:18709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17945:x1876618850278144:12345-0@lo:7:osp-pre-1-1.0 Request processed in 5961us (9492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683658.357387:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789683658.361308:0:17945:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83f16d80 x1876618850278144/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789683674 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683658.361337:0:17945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f16d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17945:1876618850278144:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1789683658.361352:0:17945:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789683658.361393:0:17945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17945:1876618850278272:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789683658.361452:0:17945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683658.361499:0:17945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9051b540 going to sleep for 11 seconds 00000100:00100000:0.0:1789683658.361548:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850278272 00000100:00100000:0.0:1789683658.361555:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850278272 00000100:00100000:0.0:1789683658.361605:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789683658.361619:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17945:x1876618850278272:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789683658.361646:0:19141:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1789683658.361680:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17945:x1876618850278272:12345-0@lo:5:osp-pre-1-1.0 Request processed in 62us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683658.361686:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789683658.361743:0:17945:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7962300 x1876618850278272/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683674 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683658.361754:0:17945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17945:1876618850278272:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789683658.361762:0:17945:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789683658.361812:0:17945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17945:1876618850278400:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789683658.361832:0:17945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683658.361845:0:17945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9051b540 going to sleep for 11 seconds 00000100:00100000:0.0:1789683658.361950:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850278400 00000100:00100000:0.0:1789683658.361954:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850278400 00000100:00100000:0.0:1789683658.361978:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789683658.361983:0:18709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17945:x1876618850278400:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789683658.362008:0:18709:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:1.0:1789683658.366084:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789683658.366098:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004917bfed/0xcf8485587b88ab59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.366116:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789683658.366121:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683658.366127:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004917bfed/0xcf8485587b88ab59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.366146:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004917bfed/0xcf8485587b88ab59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.366168:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004917bfed/0xcf8485587b88ab59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.366176:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004917bfed/0xcf8485587b88ab59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.366246:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789683658.370749:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683658.370760:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.370776:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=572s v=(0 0) 00010000:00010000:2.0:1789683658.370813:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683658.370820:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.370835:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.370852:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.370860:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789683658.371558:0:17933:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00010000:3.0:1789683658.373151:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683658.373166:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004917bfed/0xcf8485587b88ab59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.373181:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837da400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683658.373186:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004917bfed/0xcf8485587b88ab59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.373198:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004917bfed/0xcf8485587b88ab59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.373228:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004917bfed/0xcf8485587b88ab59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.373236:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004917bfed/0xcf8485587b88ab59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.373259:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683658.373270:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.373277:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683658.373280:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.373288:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.373299:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab60 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.373307:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683658.373309:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683658.373311:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683658.377110:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789683658.377124:0:18710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.377650:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683658.377754:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683658.377762:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88ab67 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.378308:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=572s v=(0 0) 00010000:00010000:2.0:1789683658.378326:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683658.378333:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88ab67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.378348:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88ab67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.378359:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88ab67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.378379:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88ab67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.378395:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789683658.378755:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683658.378763:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88ab67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.378771:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683658.378776:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88ab67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.378809:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88ab67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.378828:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88ab67 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.378835:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88ab67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.378862:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683658.378864:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683658.378866:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789683658.381822:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789683658.381837:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b3bf4fa/0xcf8485587b88ab6e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.381858:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1789683658.381863:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683658.381870:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b3bf4fa/0xcf8485587b88ab6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.381885:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b3bf4fa/0xcf8485587b88ab6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.381896:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b3bf4fa/0xcf8485587b88ab6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.381904:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b3bf4fa/0xcf8485587b88ab6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.381929:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683658.382386:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683658.382395:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b3bf4fa/0xcf8485587b88ab6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.382404:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454ca00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683658.382409:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b3bf4fa/0xcf8485587b88ab6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.382421:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b3bf4fa/0xcf8485587b88ab6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.382441:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b3bf4fa/0xcf8485587b88ab6e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.382449:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b3bf4fa/0xcf8485587b88ab6e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.382482:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.382484:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.382486:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683658.384288:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683658.384300:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.384334:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=572s v=(0 0) 00010000:00010000:2.0:1789683658.384339:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683658.384346:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.384361:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.384371:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.384378:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.384398:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789683658.384409:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683658.384414:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.384429:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683658.384434:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.384442:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.384458:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.384465:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ab0be66/0xcf8485587b88ab75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.384483:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683658.384485:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683658.384487:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683658.386002:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683658.386015:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096048049/0xcf8485587b88ab7c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.386032:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=572s v=(0 0) 00010000:00010000:2.0:1789683658.386036:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683658.386041:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096048049/0xcf8485587b88ab7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.386053:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096048049/0xcf8485587b88ab7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.386069:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096048049/0xcf8485587b88ab7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.386077:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096048049/0xcf8485587b88ab7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.386095:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683658.386330:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683658.386338:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096048049/0xcf8485587b88ab7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.386347:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683658.386352:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096048049/0xcf8485587b88ab7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.386361:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096048049/0xcf8485587b88ab7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.386377:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096048049/0xcf8485587b88ab7c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.386385:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096048049/0xcf8485587b88ab7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.386401:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.386402:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.386404:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789683658.386992:0:19524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1789683658.387006:0:19524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789683658.387009:0:19524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789683658.387218:0:18709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17945:x1876618850278400:12345-0@lo:5:osp-pre-1-1.0 Request processed in 25230us (25380us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789683658.387228:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789683658.387279:0:17945:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789683658.387286:0:17945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17945:1876618850278400:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789683658.387301:0:17945:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1789683658.387367:0:17945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17945:1876618850278528:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789683658.387405:0:17945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683658.387475:0:17945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f89dd29c0 going to sleep for 11 seconds 00002000:00010000:2.0:1789683658.387539:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683658.387545:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e0f7c5/0xcf8485587b88ab83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.387557:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=572s v=(0 0) 00010000:00010000:2.0:1789683658.387561:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683658.387566:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062e0f7c5/0xcf8485587b88ab83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.387593:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062e0f7c5/0xcf8485587b88ab83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.387603:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e0f7c5/0xcf8485587b88ab83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.387611:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062e0f7c5/0xcf8485587b88ab83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.387626:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789683658.387636:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683658.387641:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062e0f7c5/0xcf8485587b88ab83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.387648:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683658.387652:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e0f7c5/0xcf8485587b88ab83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.387661:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e0f7c5/0xcf8485587b88ab83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.387673:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062e0f7c5/0xcf8485587b88ab83 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.387680:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062e0f7c5/0xcf8485587b88ab83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.387702:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683658.387704:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683658.387706:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683658.396953:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850278528 00000100:00100000:1.0:1789683658.396969:0:17211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850278528 00000100:00100000:1.0:1789683658.397038:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789683658.397048:0:17211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17945:x1876618850278528:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789683658.397145:0:17211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17945:x1876618850278528:12345-0@lo:900:osp-pre-1-1.0 Request processed in 100us (9740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683658.397153:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789683658.397199:0:17945:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7245880 x1876618850278528/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789683674 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683658.397215:0:17945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17945:1876618850278528:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1789683658.397467:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683658.397477:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f184611/0xcf8485587b88ab8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.397494:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789683658.397498:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683658.397504:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f184611/0xcf8485587b88ab8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.397519:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f184611/0xcf8485587b88ab8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.397542:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f184611/0xcf8485587b88ab8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.397551:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f184611/0xcf8485587b88ab8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.397578:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683658.398060:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683658.398067:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f184611/0xcf8485587b88ab8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.398076:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81676400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683658.398081:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f184611/0xcf8485587b88ab8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.398091:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f184611/0xcf8485587b88ab8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.398109:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f184611/0xcf8485587b88ab8a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.398116:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f184611/0xcf8485587b88ab8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.398150:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.398151:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.398153:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683658.398942:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683658.398952:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3bf97b1/0xcf8485587b88ab91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.398965:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789683658.398969:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683658.398974:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3bf97b1/0xcf8485587b88ab91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.398986:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3bf97b1/0xcf8485587b88ab91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.398996:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3bf97b1/0xcf8485587b88ab91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.399004:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3bf97b1/0xcf8485587b88ab91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.399037:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683658.399395:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683658.399401:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88ab98 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.399410:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789683658.399413:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683658.399417:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88ab98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.399426:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88ab98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.399434:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88ab98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.399441:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88ab98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.399454:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789683658.399990:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683658.399998:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88ab9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.400007:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789683658.400016:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683658.400020:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88ab9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.400029:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88ab9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.400037:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88ab9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.400043:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88ab9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.400052:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789683658.400297:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789683658.400304:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3bf97b1/0xcf8485587b88ab91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.400312:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677e00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683658.400327:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3bf97b1/0xcf8485587b88ab91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.400338:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3bf97b1/0xcf8485587b88ab91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.400354:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3bf97b1/0xcf8485587b88ab91 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.400362:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3bf97b1/0xcf8485587b88ab91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.400382:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683658.400385:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88ab98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.400391:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683658.400401:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88ab98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.400409:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88ab98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.400420:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88ab98 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.400427:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88ab98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.400440:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683658.400443:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88ab9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.400450:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81676c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683658.400453:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88ab9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.400460:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88ab9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.400469:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88ab9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.400476:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88ab9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.400496:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.400498:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.400500:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.400508:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683658.400587:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683658.400593:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88aba6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.400601:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789683658.400604:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683658.400609:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88aba6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.400617:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88aba6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.400625:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88aba6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.400638:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88aba6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.400661:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683658.401974:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683658.401984:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88aba6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.401995:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677000 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683658.401999:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88aba6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.402009:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88aba6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.402025:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88aba6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.402032:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88aba6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.402052:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.402054:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.402055:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683658.405501:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683658.405516:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.405534:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789683658.405539:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683658.405545:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.405559:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.405570:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.405578:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.405604:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683658.405821:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683658.405828:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.405843:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81676800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683658.405848:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.405858:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.405875:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.405882:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.405900:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683658.405903:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683658.405904:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683658.409027:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683658.409042:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88abb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.409059:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=572s v=(0 0) 00010000:00010000:2.0:1789683658.409064:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683658.409070:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88abb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.409083:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88abb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.409093:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88abb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.409100:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88abb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.409157:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789683658.409561:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683658.409568:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88abbb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.409586:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=572s v=(0 0) 00010000:00010000:2.0:1789683658.409590:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683658.409594:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88abbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.409603:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88abbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.409611:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88abbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.409618:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88abbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.412679:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683658.412694:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88abb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.412720:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9200 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683658.412726:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88abb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.412737:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88abb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.412756:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88abb4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.412764:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cef1f3ff/0xcf8485587b88abb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.412809:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683658.412813:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88abbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.412820:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683658.412823:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88abbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.412831:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88abbb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.412842:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88abbb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.412855:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683658.412857:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683658.412859:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683658.413065:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789683658.413074:0:18710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88abbb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789683658.413615:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683658.413624:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88abc2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.413639:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=572s v=(0 0) 00010000:00010000:2.0:1789683658.413645:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683658.413651:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88abc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.413676:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88abc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.413686:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88abc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.413695:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88abc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.417551:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683658.417565:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88abc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.417586:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683658.417590:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88abc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.417602:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88abc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.417623:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88abc2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.417631:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.417632:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.417634:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683658.417752:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789683658.417761:0:18710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88abc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789683658.418362:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683658.418369:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88abc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.418381:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=572s v=(0 0) 00010000:00010000:2.0:1789683658.418386:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683658.418392:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88abc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.418404:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88abc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.418424:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88abc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.418432:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88abc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.418737:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683658.418745:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88abc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.418753:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176a00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683658.418758:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88abc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.418767:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88abc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.418800:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88abc9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.418809:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683658.418810:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683658.418812:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683658.418935:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789683658.418941:0:18710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88abc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789683658.419229:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683658.419235:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88abd0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.419244:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=572s v=(0 0) 00010000:00010000:2.0:1789683658.419247:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683658.419251:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88abd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.419261:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88abd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.419269:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88abd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.419286:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88abd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.419853:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683658.419860:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88abd0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.419868:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683658.419873:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88abd0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.419882:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88abd0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.419895:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88abd0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.419908:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.419909:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.419911:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683658.425283:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789683658.425303:0:18710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88abd0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.425401:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683658.428360:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683658.428372:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.428388:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789683658.428392:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683658.428398:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.428411:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.428429:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.428436:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.428461:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683658.428735:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683658.428745:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.428754:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81676800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683658.428759:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.428768:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.428813:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abd7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.428821:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008cc48ae/0xcf8485587b88abd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.428837:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.428839:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.428842:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683658.428972:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683658.428978:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004681c271/0xcf8485587b88abde lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.428987:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789683658.428990:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683658.428995:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004681c271/0xcf8485587b88abde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429004:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004681c271/0xcf8485587b88abde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429012:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004681c271/0xcf8485587b88abde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429019:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004681c271/0xcf8485587b88abde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429054:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683658.429335:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683658.429341:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015e4c65c/0xcf8485587b88abe5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429349:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789683658.429352:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683658.429356:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015e4c65c/0xcf8485587b88abe5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429365:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015e4c65c/0xcf8485587b88abe5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429372:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015e4c65c/0xcf8485587b88abe5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429378:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015e4c65c/0xcf8485587b88abe5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429397:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789683658.429406:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683658.429410:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004681c271/0xcf8485587b88abde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429418:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683658.429427:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004681c271/0xcf8485587b88abde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429436:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004681c271/0xcf8485587b88abde lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429446:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004681c271/0xcf8485587b88abde lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429453:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004681c271/0xcf8485587b88abde lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429468:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683658.429472:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015e4c65c/0xcf8485587b88abe5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429478:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:3.0:1789683658.429481:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015e4c65c/0xcf8485587b88abe5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429487:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015e4c65c/0xcf8485587b88abe5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429496:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015e4c65c/0xcf8485587b88abe5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429503:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015e4c65c/0xcf8485587b88abe5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429521:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683658.429522:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683658.429524:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683658.429772:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789683658.429868:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683658.429912:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88abec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429921:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789683658.429924:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683658.429928:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88abec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429937:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88abec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429946:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88abec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.429954:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88abec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.430004:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683658.430407:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683658.430414:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88abf3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.430433:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789683658.430436:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683658.430440:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88abf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.430449:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88abf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.430456:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88abf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.430463:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88abf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.434056:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683658.434069:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88abec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.434088:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677000 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683658.434093:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88abec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.434105:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88abec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.434126:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88abec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.434134:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afb8ab59/0xcf8485587b88abec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.434155:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683658.434159:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88abf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.434165:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81676c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:1.0:1789683658.434167:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88abf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.434175:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88abf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.434184:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88abf3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683658.434197:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.434198:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683658.434200:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683658.435244:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789683658.435254:0:18710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ab57d7/0xcf8485587b88abf3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683658.438754:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789683658.438769:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88abfa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.438818:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789683658.438824:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683658.438831:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88abfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.438860:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88abfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.438872:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88abfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683658.438879:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88abfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.439426:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683658.439437:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88abfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.439446:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683658.439457:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88abfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.439466:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88abfa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.439485:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88abfa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.439495:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683658.439496:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683658.439498:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683658.440200:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789683658.440209:0:18710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8ba7858/0xcf8485587b88abfa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.440322:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683658.445073:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683658.445086:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88ac01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.445105:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=572s v=(0 0) 00010000:00010000:2.0:1789683658.445110:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683658.445117:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88ac01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.445133:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88ac01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.445143:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88ac01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.445151:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88ac01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.445196:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789683658.445499:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683658.445505:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88ac08 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.445514:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=572s v=(0 0) 00010000:00010000:2.0:1789683658.445517:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683658.445521:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88ac08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.445531:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88ac08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.445539:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88ac08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.445546:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88ac08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.445561:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789683658.445859:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683658.445865:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88ac0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.445874:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=572s v=(0 0) 00010000:00010000:2.0:1789683658.445884:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683658.445888:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88ac0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.445897:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88ac0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.445906:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88ac0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.445913:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88ac0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.445921:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789683658.446229:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789683658.446236:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88ac16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.446245:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=572s v=(0 0) 00010000:00010000:2.0:1789683658.446248:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683658.446251:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88ac16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.446261:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88ac16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.446268:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88ac16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.446283:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88ac16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683658.446292:0:18710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:2.0:1789683658.446335:0:18710:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:2.0:1789683658.446428:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17227:x1876618850277888:12345-0@lo:5:osp-pre-1-0.0 Request processed in 98996us (99503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683658.446438:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1789683658.446545:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789683658.446553:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88ac01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446561:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177c00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683658.446565:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88ac01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446576:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88ac01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446594:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88ac01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446601:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c25e5a9e/0xcf8485587b88ac01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446627:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789683658.446631:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88ac08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446638:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176a00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683658.446641:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88ac08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446649:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88ac08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446659:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88ac08 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446666:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa97db86/0xcf8485587b88ac08 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446678:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683658.446681:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88ac0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446686:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6177400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683658.446689:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88ac0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446707:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88ac0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446717:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88ac0f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446725:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ff508/0xcf8485587b88ac0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446738:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683658.446741:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88ac16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446747:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176600 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:0.0:1789683658.446750:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88ac16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446758:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88ac16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446767:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88ac16 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.446774:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7def199/0xcf8485587b88ac16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683658.447075:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683658.447077:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683658.447078:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683658.447086:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683658.447270:0:17227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f14380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17227:1876618850277888:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789683658.447287:0:17227:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1789683658.447351:0:17227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f14380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17227:1876618850278656:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789683658.447395:0:17227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683658.447434:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc151f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683658.448925:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850278656 00000100:00100000:0.0:1789683658.448940:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850278656 00000100:00100000:0.0:1789683658.448998:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789683658.449008:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17227:x1876618850278656:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789683658.449054:0:18708:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:2.0:1789683658.453717:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17227:x1876618850278656:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4704us (6314us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789683658.453731:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789683658.453868:0:17227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f14380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17227:1876618850278656:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789683658.453886:0:17227:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:1.0:1789683659.295960:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683660.321514:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683660.383914:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683660.383943:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850278784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683660.384016:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683660.384071:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850278784 00000100:00100000:1.0:1789683660.384079:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850278784 00000100:00100000:1.0:1789683660.384130:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789683660.384140:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850278784:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789683660.384305:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850278912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683660.384340:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683660.384378:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850278912 00000100:00100000:2.0:1789683660.384382:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850278912 00000100:00100000:2.0:1789683660.384420:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789683660.384427:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850278912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789683660.384450:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789683660.384492:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850278912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683660.384498:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789683660.384519:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683660.384555:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850278912:0@lo:13:osp-pre-0-1.0 00000004:00000024:1.0:1789683660.384609:0:17941:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789683660.384656:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850278784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 517us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683660.384663:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789683660.384828:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850278784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683660.385031:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683660.385041:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850279040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683660.385070:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683660.385160:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850279040 00000100:00100000:1.0:1789683660.385164:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850279040 00000100:00100000:1.0:1789683660.385270:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789683660.385277:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850279040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789683660.385306:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789683660.385347:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850279040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683660.385353:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789683660.385418:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850279040:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1789683660.449311:0:19880:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1789683661.087541:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789683661.343006:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683661.408594:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850279168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683661.408688:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683661.408751:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850279168 00000100:00100000:2.0:1789683661.408759:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850279168 00000100:00100000:2.0:1789683661.408837:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789683661.408845:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850279168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789683661.408868:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789683661.408911:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850279168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683661.408917:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789683661.408938:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683661.408975:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850279168:0@lo:13:osp-pre-0-0.0 00000020:00000004:3.0:1789683661.586538:0:19932:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789683661.587040:0:19932:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789683662.369452:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789683662.908747:0:19982:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789683662.909057:0:19982:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789683663.225008:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683663.225100:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835511552 00000100:00100000:3.0:1789683663.225111:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835511552 00000100:00100000:1.0:1789683663.225306:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 117 00000100:00100000:1.0:1789683663.225316:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1876618835511552:12345-192.168.201.50@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789683663.225360:0:17193:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from d5a4b989-8a1a-4887-96c1-b874fd2dfe72@192.168.201.50@tcp t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:1.0:1789683663.225395:0:17193:0:(genops.c:1384:class_connect()) connect: client d5a4b989-8a1a-4887-96c1-b874fd2dfe72, cookie 0xcf8485587b88ac1d 00000100:00080000:1.0:1789683663.225650:0:17193:0:(import.c:65:import_set_state_nolock()) ffff9f0e82e41800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683663.225737:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+5:2401:x1876618835511552:12345-192.168.201.50@tcp:250:mount.lustre.0 Request processed in 420us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683663.225746:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 117 00000100:00100000:1.0:1789683663.231431:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683663.231528:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835511680 00000100:00100000:3.0:1789683663.231540:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835511680 00000100:00100000:3.0:1789683663.231604:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 118 00000100:00100000:3.0:1789683663.231616:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc037b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+5:14886:x1876618835511680:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789683663.231635:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683663.231655:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81677600/0xcf8485587b88ac24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc8f5 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683663.231716:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81677600/0xcf8485587b88ac24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8f5 expref: 6 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683663.231731:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81677600/0xcf8485587b88ac24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8f5 expref: 6 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683663.231741:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81677600, rc 0) 00000100:00100000:3.0:1789683663.231830:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc037b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+6:14886:x1876618835511680:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 217us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683663.231837:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 118 00000100:00100000:2.0:1789683663.237487:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683663.237557:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835511808 00000100:00100000:1.0:1789683663.237568:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835511808 00000100:00100000:1.0:1789683663.237634:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 119 00000100:00100000:1.0:1789683663.237645:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+6:14886:x1876618835511808:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789683663.237829:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+6:14886:x1876618835511808:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 185us (350us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789683663.237837:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 119 00000100:00100000:1.0:1789683663.250484:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683663.250602:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835511936 00000100:00100000:2.0:1789683663.250614:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835511936 00000100:00100000:2.0:1789683663.250682:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 120 00000100:00100000:2.0:1789683663.250695:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc037a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+6:14886:x1876618835511936:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789683663.250717:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683663.250738:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb6177c00/0xcf8485587b88ac2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc8fc expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683663.250767:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb6177c00/0xcf8485587b88ac2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8fc expref: 7 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683663.250845:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb6177c00/0xcf8485587b88ac2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc8fc expref: 7 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683663.250855:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6177c00, rc 0) 00000100:00100000:2.0:1789683663.250933:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc037a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+7:14886:x1876618835511936:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 240us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683663.250942:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 120 00000100:00100000:2.0:1789683663.257033:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683663.257333:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835512064 00000100:00100000:0.0:1789683663.257345:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835512064 00000100:00100000:0.0:1789683663.257407:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 121 00000100:00100000:0.0:1789683663.257418:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc037bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+7:14886:x1876618835512064:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789683663.257606:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc037bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+8:14886:x1876618835512064:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 188us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683663.257614:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 121 00000100:00100000:3.0:1789683663.262739:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683663.265849:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835512192 00000100:00100000:1.0:1789683663.265883:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835512192 00000100:00100000:2.0:1789683663.271976:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 122 00000100:00100000:2.0:1789683663.271990:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+8:14886:x1876618835512192:12345-192.168.201.50@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789683663.272182:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+8:14886:x1876618835512192:12345-192.168.201.50@tcp:503:mount.lustre.0 Request processed in 194us (9452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683663.272190:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 122 00000100:00100000:1.0:1789683663.285073:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683663.285286:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835512320 00000100:00100000:2.0:1789683663.285296:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835512320 00000100:00100000:2.0:1789683663.285356:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 123 00000100:00100000:2.0:1789683663.285367:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+8:14904:x1876618835512320:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789683663.285523:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+8:14904:x1876618835512320:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 156us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683663.285538:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 123 00000100:00100000:1.0:1789683663.341954:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683663.348994:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835512448 00000100:00100000:2.0:1789683663.349015:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835512448 00000100:00100000:2.0:1789683663.349169:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 124 00000100:00100000:2.0:1789683663.349181:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc037a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+8:14904:x1876618835512448:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789683663.349444:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc037a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+8:14904:x1876618835512448:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 264us (8289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683663.349453:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 124 00000100:00100000:3.0:1789683663.352894:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683663.352991:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835512576 00000100:00100000:0.0:1789683663.353002:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835512576 00000100:00100000:0.0:1789683663.353067:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 125 00000100:00100000:0.0:1789683663.353081:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+8:14904:x1876618835512576:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789683663.353306:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+8:14904:x1876618835512576:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 227us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683663.353324:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 125 00000100:00100000:0.0:1789683663.366671:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683663.366968:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835512704 00000100:00100000:3.0:1789683663.366979:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835512704 00000100:00100000:3.0:1789683663.367077:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 126 00000100:00100000:3.0:1789683663.367090:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc037a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+8:14886:x1876618835512704:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789683663.367110:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683663.367135:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81676c00/0xcf8485587b88ac32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc92d expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683663.367244:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81676c00/0xcf8485587b88ac32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc92d expref: 9 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683663.367261:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81676c00/0xcf8485587b88ac32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc92d expref: 9 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683663.367275:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81676c00, rc 0) 00000100:00100000:3.0:1789683663.367413:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc037a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+9:14886:x1876618835512704:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 325us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683663.367420:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 126 00000100:00100000:3.0:1789683663.371639:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683663.371736:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835512832 00000100:00100000:2.0:1789683663.371756:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835512832 00000100:00100000:2.0:1789683663.371854:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 127 00000100:00100000:2.0:1789683663.371865:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc037b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+9:14886:x1876618835512832:12345-192.168.201.50@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789683663.371897:0:17193:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789683663.371926:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789683663.371931:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789683663.371934:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789683663.371937:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789683663.371940:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789683663.374862:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc037b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+9:14886:x1876618835512832:12345-192.168.201.50@tcp:256:mount.lustre.0 Request processed in 2986us (3222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683663.374879:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 127 00000100:00100000:0.0:1789683663.380260:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683663.380443:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835512960 00000100:00100000:3.0:1789683663.380455:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835512960 00000100:00100000:3.0:1789683663.380526:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 128 00000100:00100000:3.0:1789683663.380537:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+9:14886:x1876618835512960:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789683663.380555:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683663.380572:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81677800/0xcf8485587b88ac39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc934 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683663.380600:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81677800/0xcf8485587b88ac39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc934 expref: 10 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683663.380613:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81677800/0xcf8485587b88ac39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc934 expref: 10 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683663.380623:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81677800, rc 0) 00000100:00100000:3.0:1789683663.380728:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+10:14886:x1876618835512960:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 191us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683663.380735:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 128 00000100:00100000:3.0:1789683663.383330:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683663.383424:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835513088 00000100:00100000:0.0:1789683663.383434:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835513088 00000100:00100000:0.0:1789683663.383584:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 129 00000100:00100000:0.0:1789683663.383594:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+10:14886:x1876618835513088:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789683663.384137:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+10:14886:x1876618835513088:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 542us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683663.384145:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 129 00010000:00010000:1.0:1789683663.393136:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683663.395130:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683663.395236:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835513216 00000100:00100000:1.0:1789683663.395248:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835513216 00000100:00100000:1.0:1789683663.395305:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 130 00000100:00100000:1.0:1789683663.395317:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+10:14886:x1876618835513216:12345-192.168.201.50@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789683663.395487:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+10:14886:x1876618835513216:12345-192.168.201.50@tcp:503:mount.lustre.0 Request processed in 172us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683663.395496:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 130 00000100:00100000:2.0:1789683663.398090:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683663.398187:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835513344 00000100:00100000:0.0:1789683663.398197:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835513344 00000100:00100000:0.0:1789683663.398264:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 131 00000100:00100000:0.0:1789683663.398274:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+10:14907:x1876618835513344:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789683663.398434:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+10:14907:x1876618835513344:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 160us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683663.398441:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 131 00000100:00100000:2.0:1789683663.401396:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683663.401631:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835513472 00000100:00100000:3.0:1789683663.401642:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835513472 00000100:00100000:3.0:1789683663.401710:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 132 00000100:00100000:3.0:1789683663.401722:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+10:14907:x1876618835513472:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789683663.401943:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+10:14907:x1876618835513472:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 221us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683663.401951:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 132 00000100:00100000:2.0:1789683663.419812:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683663.419967:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683663.429857:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835513600 00000100:00100000:0.0:1789683663.429875:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835513600 00000100:00100000:0.0:1789683663.429945:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835513856 00000100:00100000:0.0:1789683663.429949:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835513856 00000100:00100000:0.0:1789683663.429987:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:0.0:1789683663.429997:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1876618835513600:12345-192.168.201.50@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789683663.430052:0:17200:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1acf7a90-98f6-4b44-899e-7c61b5867591@192.168.201.50@tcp t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:0.0:1789683663.430108:0:17200:0:(genops.c:1384:class_connect()) connect: client 1acf7a90-98f6-4b44-899e-7c61b5867591, cookie 0xcf8485587b88ac40 00000004:00100000:0.0:1789683663.430138:0:17200:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00100000:3.0:1789683663.433706:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:3.0:1789683663.433719:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1876618835513856:12345-192.168.201.50@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789683663.433761:0:17202:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 1acf7a90-98f6-4b44-899e-7c61b5867591@192.168.201.50@tcp t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:3.0:1789683663.433851:0:17202:0:(genops.c:1384:class_connect()) connect: client 1acf7a90-98f6-4b44-899e-7c61b5867591, cookie 0xcf8485587b88ac47 00000004:00100000:3.0:1789683663.433882:0:17202:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:3.0:1789683663.434178:0:17202:0:(import.c:65:import_set_state_nolock()) ffff9f0e8253e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683663.434271:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+6:2401:x1876618835513856:12345-192.168.201.50@tcp:38:mount.lustre.0 Request processed in 551us (14303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683663.434279:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00080000:0.0:1789683663.435991:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9f0e825e0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683663.436096:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+6:2401:x1876618835513600:12345-192.168.201.50@tcp:38:mount.lustre.0 Request processed in 6098us (16317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683663.436106:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:2.0:1789683663.437914:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683663.438041:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835513984 00000100:00100000:3.0:1789683663.438050:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835513984 00000100:00100000:3.0:1789683663.438122:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:3.0:1789683663.438133:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+6:0:x1876618835513984:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789683663.438168:0:17202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789683663.438278:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+6:0:x1876618835513984:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 146us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683663.438285:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00080000:2.0:1789683663.438703:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683663.443927:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683663.443976:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683663.444164:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835513728 00000100:00100000:2.0:1789683663.444174:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835513728 00000100:00100000:2.0:1789683663.444254:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835514112 00000100:00100000:2.0:1789683663.444258:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835514112 00000100:00100000:2.0:1789683663.444282:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:2.0:1789683663.444292:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+7:0:x1876618835513728:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789683663.444335:0:18733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789683663.444443:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+7:0:x1876618835513728:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 151us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683663.444450:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:2.0:1789683663.444472:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:2.0:1789683663.444479:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+6:14886:x1876618835514112:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789683663.444490:0:18733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789683663.444525:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+6:14886:x1876618835514112:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 46us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683663.444540:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00080000:3.0:1789683663.445480:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683663.447018:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683663.447248:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835514240 00000100:00100000:2.0:1789683663.447259:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835514240 00000100:00100000:2.0:1789683663.447383:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:2.0:1789683663.447394:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+6:14886:x1876618835514240:12345-192.168.201.50@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789683663.447502:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+6:14886:x1876618835514240:12345-192.168.201.50@tcp:40:mount.lustre.0 Request processed in 110us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683663.447517:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:3.0:1789683663.454719:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683663.454819:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683663.454892:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683663.455146:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835514624 00000100:00100000:1.0:1789683663.455157:0:17211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835514624 00000100:00100000:1.0:1789683663.455281:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:1.0:1789683663.455292:0:17211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1acf7a90-98f6-4b44-899e-7c61b5867591+6:14886:x1876618835514624:12345-192.168.201.50@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789683663.455384:0:17211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1acf7a90-98f6-4b44-899e-7c61b5867591+6:14886:x1876618835514624:12345-192.168.201.50@tcp:900:mount.lustre.0 Request processed in 93us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683663.455392:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:1.0:1789683663.455473:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850279296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683663.455521:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683663.455592:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850279296 00000100:00100000:1.0:1789683663.455597:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850279296 00000100:00100000:1.0:1789683663.455630:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789683663.455638:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1876618850279296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789683663.455660:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789683663.455711:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1876618850279296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683663.455727:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789683663.455748:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683663.455802:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850279296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683663.455923:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835514368 00000100:00100000:1.0:1789683663.455928:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835514368 00000100:00100000:1.0:1789683663.455953:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835514496 00000100:00100000:1.0:1789683663.455957:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835514496 00000100:00100000:1.0:1789683663.455975:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:1.0:1789683663.455980:0:18709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1876618835514368:12345-192.168.201.50@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789683663.456025:0:18709:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1acf7a90-98f6-4b44-899e-7c61b5867591@192.168.201.50@tcp t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:1.0:1789683663.456054:0:18709:0:(genops.c:1384:class_connect()) connect: client 1acf7a90-98f6-4b44-899e-7c61b5867591, cookie 0xcf8485587b88ac4e 00002000:00100000:1.0:1789683663.456069:0:18709:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1acf7a90-98f6-4b44-899e-7c61b5867591/ffff9f0e82e46000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789683663.456088:0:18709:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1789683663.456330:0:18709:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789683663.456361:0:18709:0:(import.c:65:import_set_state_nolock()) ffff9f0e82e43800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683663.456400:0:18709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+6:2401:x1876618835514368:12345-192.168.201.50@tcp:8:mount.lustre.0 Request processed in 418us (1617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683663.456407:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:1.0:1789683663.456421:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:1.0:1789683663.456425:0:18709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1876618835514496:12345-192.168.201.50@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789683663.456441:0:18709:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1acf7a90-98f6-4b44-899e-7c61b5867591@192.168.201.50@tcp t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:1.0:1789683663.456458:0:18709:0:(genops.c:1384:class_connect()) connect: client 1acf7a90-98f6-4b44-899e-7c61b5867591, cookie 0xcf8485587b88ac55 00002000:00100000:1.0:1789683663.456463:0:18709:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1acf7a90-98f6-4b44-899e-7c61b5867591/ffff9f0e82e44800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789683663.456476:0:18709:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1789683663.456587:0:18709:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789683663.456602:0:18709:0:(import.c:65:import_set_state_nolock()) ffff9f0e82e47000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683663.456625:0:18709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+6:2401:x1876618835514496:12345-192.168.201.50@tcp:8:mount.lustre.0 Request processed in 198us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683663.456631:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:1.0:1789683663.466725:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850279424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789683663.466828:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683663.466894:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850279424 00000100:00100000:1.0:1789683663.466903:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850279424 00000100:00100000:1.0:1789683663.466960:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789683663.466969:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850279424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789683663.466993:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789683663.467040:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850279424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683663.467047:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789683663.467070:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683663.467105:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850279424:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1789683663.468510:0:19524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1acf7a90-98f6-4b44-899e-7c61b5867591 00000001:00080000:0.0:1789683663.468523:0:19524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:3.0:1789683663.470767:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850279680:0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.470869:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683663.470913:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850280192:0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.470939:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683663.470959:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850280704:0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.470982:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683663.471010:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789683663.471015:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850279808:0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.471038:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683663.471058:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850280320:0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.471076:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683663.471092:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1876618850280832:0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.471110:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683663.471139:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850279680 00000100:00100000:3.0:1789683663.471147:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850279680 00000100:00100000:3.0:1789683663.471196:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789683663.471205:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850279680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.471278:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850279680:12345-0@lo:400:kworker.0 Request processed in 74us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683663.471286:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789683663.471309:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850280704 00000100:00100000:3.0:1789683663.471314:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850280704 00000100:00100000:3.0:1789683663.471347:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850280320 00000100:00100000:3.0:1789683663.471350:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850280320 00000100:00100000:3.0:1789683663.471379:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850280832 00000100:00100000:3.0:1789683663.471382:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850280832 00000100:00100000:3.0:1789683663.471397:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789683663.471403:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850280704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.471435:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850280704:12345-0@lo:400:kworker.0 Request processed in 33us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683663.471440:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789683663.471452:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789683663.471457:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850280320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.471481:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850280320:12345-0@lo:400:kworker.0 Request processed in 24us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683663.471486:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789683663.471496:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789683663.471502:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876618850280832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.471525:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876618850280832:12345-0@lo:400:kworker.0 Request processed in 24us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683663.471530:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789683663.471551:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850280192 00000100:00100000:3.0:1789683663.471554:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850280192 00000100:00100000:3.0:1789683663.471577:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850279808 00000100:00100000:3.0:1789683663.471579:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850279808 00000100:00100000:3.0:1789683663.471594:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683663.471600:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850280192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.471629:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850280192:12345-0@lo:400:kworker.0 Request processed in 29us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683663.471634:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683663.471644:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789683663.471658:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850279808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.471686:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850279808:12345-0@lo:400:kworker.0 Request processed in 30us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683663.471691:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789683663.471707:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789683663.471711:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789683663.471713:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683663.471731:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850279936:0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.471757:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683663.471775:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850280448:0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.471824:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683663.471841:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789683663.471847:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3649:1876618850279552:0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.471872:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683663.471898:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850280064:0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.471920:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683663.471938:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850280576:0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.471957:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683663.471978:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850280064 00000100:00100000:3.0:1789683663.471982:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850280064 00000100:00100000:3.0:1789683663.472007:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789683663.472012:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850280064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.472047:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850280064:12345-0@lo:400:kworker.0 Request processed in 34us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683663.472053:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789683663.472069:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850279936 00000100:00100000:3.0:1789683663.472078:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850279936 00000100:00100000:3.0:1789683663.472095:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850280448 00000100:00100000:3.0:1789683663.472097:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850280448 00000100:00100000:3.0:1789683663.472115:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850280576 00000100:00100000:3.0:1789683663.472118:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850280576 00000100:00100000:3.0:1789683663.472132:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789683663.472136:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850279936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.472165:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876618850279936:12345-0@lo:400:kworker.0 Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683663.472171:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789683663.472182:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789683663.472187:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850280448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.472213:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876618850280448:12345-0@lo:400:kworker.0 Request processed in 26us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683663.472218:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789683663.472243:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789683663.472249:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850280576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.472276:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850280576:12345-0@lo:400:kworker.0 Request processed in 28us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683663.472281:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789683663.472296:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789683663.472298:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683663.472331:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850279808:0@lo:400:kworker.0 00010000:00080000:3.0:1789683663.472344:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0727480 x1876618850280320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683663.472355:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850280320:0@lo:400:kworker.0 00010000:00080000:3.0:1789683663.472378:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb6172a00 x1876618850280832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683663.472386:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1876618850280832:0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.472396:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850279680:0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.472406:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850280192:0@lo:400:kworker.0 00010000:00080000:3.0:1789683663.472414:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb6171880 x1876618850280704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683663.472421:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850280704:0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.472457:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850280064:0@lo:400:kworker.0 00010000:00080000:3.0:1789683663.472466:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0724700 x1876618850280576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683663.472473:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850280576:0@lo:400:kworker.0 00010000:00080000:3.0:1789683663.472481:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0724380 x1876618850279936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683663.472488:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876618850279936:0@lo:400:kworker.0 00010000:00080000:3.0:1789683663.472496:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0726d80 x1876618850280448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683663.472504:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1876618850280448:0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.472534:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850279552 00000100:00100000:3.0:1789683663.472538:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850279552 00000100:00100000:3.0:1789683663.472563:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789683663.472576:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3649:x1876618850279552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.472610:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3649:x1876618850279552:12345-0@lo:400:kworker.0 Request processed in 35us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683663.472616:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789683663.472645:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3649:1876618850279552:0@lo:400:kworker.0 00000100:00100000:3.0:1789683663.475472:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683663.479839:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835514752 00000100:00100000:1.0:1789683663.479857:0:17203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835514752 00000100:00100000:1.0:1789683663.480002:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:1.0:1789683663.480017:0:17203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+6:14886:x1876618835514752:12345-192.168.201.50@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789683663.484438:0:17203:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4319us 00000004:00200000:2.0:1789683663.512547:0:17203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789683663.512698:0:17203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+6:14886:x1876618835514752:12345-192.168.201.50@tcp:33:mount.lustre.0 Request processed in 32672us (37235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683663.512715:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:3.0:1789683663.803771:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683663.804000:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835514880 00000100:00100000:0.0:1789683663.804020:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835514880 00000100:00100000:0.0:1789683663.804076:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:0.0:1789683663.804086:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+6:14930:x1876618835514880:12345-192.168.201.50@tcp:101:mkdir.0 00010000:00010000:0.0:1789683663.804107:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683663.804132:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88ac5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc965 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683663.804713:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88ac63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683663.804730:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88ac63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683663.804758:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88ac63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683663.804838:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789683663.804843:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683663.804890:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88ac63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683663.804918:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454dc00/0xcf8485587b88ac5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc965 expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683663.804936:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88ac63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc965 expref: 7 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683663.804945:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f82a2bd00) 00010000:00010000:0.0:1789683663.804948:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683663.804952:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454da00, rc 0) 00000100:00100000:0.0:1789683663.805167:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+7:14930:x1876618835514880:12345-192.168.201.50@tcp:101:mkdir.0 Request processed in 1081us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683663.805175:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00010000:00010000:3.0:1789683664.416270:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683665.439381:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683665.503882:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850280960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683665.504007:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683665.504351:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850281088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683665.504390:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683665.504458:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850280960 00000100:00100000:2.0:1789683665.504468:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850280960 00000100:00100000:2.0:1789683665.504518:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850281088 00000100:00100000:2.0:1789683665.504520:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850281088 00000100:00100000:2.0:1789683665.504532:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789683665.504545:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850280960:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683665.504566:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789683665.504580:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850281088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683665.504587:0:17941:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000004:00000024:1.0:1789683665.504602:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789683665.504635:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850280960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683665.504640:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789683665.504659:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850281088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683665.504667:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789683665.504715:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850281088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789683665.505091:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850281216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789683665.505127:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683665.505253:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850280960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683665.506157:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850281216 00000100:00100000:3.0:1789683665.506167:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850281216 00000100:00100000:3.0:1789683665.506247:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683665.506258:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850281216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789683665.506323:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1789683665.506370:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683665.506397:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850281216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683665.506405:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789683665.506446:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850281216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683666.110897:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683666.111378:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835515008 00000100:00100000:3.0:1789683666.111390:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835515008 00000100:00100000:3.0:1789683666.111496:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:3.0:1789683666.111509:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+7:14982:x1876618835515008:12345-192.168.201.50@tcp:41:lfs.0 00000004:00000024:3.0:1789683666.111562:0:18733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789683666.111684:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+7:14982:x1876618835515008:12345-192.168.201.50@tcp:41:lfs.0 Request processed in 177us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683666.111697:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00080000:0.0:1789683666.112153:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683666.122682:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683666.123110:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835515136 00000100:00100000:3.0:1789683666.123133:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835515136 00000100:00100000:3.0:1789683666.123237:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:3.0:1789683666.123250:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+6:14982:x1876618835515136:12345-192.168.201.50@tcp:41:lfs.0 00000004:00000024:3.0:1789683666.123290:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789683666.123368:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+6:14982:x1876618835515136:12345-192.168.201.50@tcp:41:lfs.0 Request processed in 122us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683666.123376:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00080000:0.0:1789683666.127024:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683666.128002:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683666.132386:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835515264 00000100:00100000:1.0:1789683666.132401:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835515264 00000100:00100000:1.0:1789683666.132618:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:1.0:1789683666.132629:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1acf7a90-98f6-4b44-899e-7c61b5867591+6:14982:x1876618835515264:12345-192.168.201.50@tcp:13:lfs.0 00002000:00000024:1.0:1789683666.132666:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789683666.132822:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1acf7a90-98f6-4b44-899e-7c61b5867591+6:14982:x1876618835515264:12345-192.168.201.50@tcp:13:lfs.0 Request processed in 195us (4828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683666.132830:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:3.0:1789683666.137320:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683666.140153:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835515392 00000100:00100000:1.0:1789683666.140169:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835515392 00000100:00080000:0.0:1789683666.140279:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683666.140284:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683666.142381:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:1.0:1789683666.142398:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1acf7a90-98f6-4b44-899e-7c61b5867591+5:14982:x1876618835515392:12345-192.168.201.50@tcp:13:lfs.0 00002000:00000024:1.0:1789683666.142434:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789683666.143112:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1acf7a90-98f6-4b44-899e-7c61b5867591+5:14982:x1876618835515392:12345-192.168.201.50@tcp:13:lfs.0 Request processed in 717us (5993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683666.143130:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00010000:00010000:3.0:1789683666.463426:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683666.527224:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850281344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683666.527317:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683666.527438:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850281344 00000100:00100000:3.0:1789683666.527448:0:18712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850281344 00000100:00100000:3.0:1789683666.527516:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789683666.527527:0:18712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850281344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683666.527554:0:18712:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789683666.527605:0:18712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850281344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683666.527611:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789683666.527661:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850281344:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789683666.527743:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683666.534564:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683666.534696:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835515520 00000100:00100000:0.0:1789683666.534707:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835515520 00000100:00100000:0.0:1789683666.534778:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 134 00000100:00100000:0.0:1789683666.534836:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+10:15014:x1876618835515520:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789683666.534874:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683666.534893:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f8454dc00/0xcf8485587b88ac6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc96c expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683666.534925:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f8454dc00/0xcf8485587b88ac6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc96c expref: 11 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683666.534938:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f8454dc00/0xcf8485587b88ac6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc96c expref: 11 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683666.534947:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454dc00, rc 0) 00000100:00100000:0.0:1789683666.535025:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+11:15014:x1876618835515520:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 192us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683666.535035:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 134 00000100:00100000:3.0:1789683666.551895:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683666.552207:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835515648 00000100:00100000:0.0:1789683666.552218:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835515648 00000100:00100000:0.0:1789683666.552279:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 135 00000100:00100000:0.0:1789683666.552290:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+11:15014:x1876618835515648:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789683666.552471:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+11:15014:x1876618835515648:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 182us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683666.552479:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 135 00000100:00100000:1.0:1789683666.555434:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683666.555536:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835515776 00000100:00100000:3.0:1789683666.555547:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835515776 00000100:00100000:3.0:1789683666.555604:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 136 00000100:00100000:3.0:1789683666.555615:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e837d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+11:15014:x1876618835515776:12345-192.168.201.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789683666.555858:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e837d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+11:15014:x1876618835515776:12345-192.168.201.50@tcp:503:mount.lustre.0 Request processed in 244us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683666.556022:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 136 00000100:00100000:3.0:1789683666.565287:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683666.565554:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835515904 00000100:00100000:0.0:1789683666.565567:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835515904 00000100:00100000:0.0:1789683666.565629:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 137 00000100:00100000:0.0:1789683666.565639:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+11:15020:x1876618835515904:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789683666.565867:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+11:15020:x1876618835515904:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 228us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683666.566064:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 137 00000100:00100000:0.0:1789683666.593447:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683666.593820:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835516032 00000100:00100000:3.0:1789683666.593833:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835516032 00000100:00100000:3.0:1789683666.593906:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 138 00000100:00100000:3.0:1789683666.593917:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+11:15020:x1876618835516032:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789683666.594272:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+11:15020:x1876618835516032:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 356us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683666.594281:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 138 00000100:00100000:1.0:1789683666.604290:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683666.605054:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835516160 00000100:00100000:0.0:1789683666.605067:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835516160 00000100:00100000:0.0:1789683666.605213:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 139 00000100:00100000:0.0:1789683666.605224:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+11:15020:x1876618835516160:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789683666.605383:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+11:15020:x1876618835516160:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 160us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683666.605392:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 139 00000100:00100000:0.0:1789683666.617274:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683666.623387:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835516288 00000100:00100000:2.0:1789683666.623403:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835516288 00000100:00100000:2.0:1789683666.623622:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 140 00000100:00100000:2.0:1789683666.623634:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+11:15014:x1876618835516288:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789683666.623653:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683666.623673:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb6176000/0xcf8485587b88ac71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc99d expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683666.623704:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb6176000/0xcf8485587b88ac71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc99d expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683666.623716:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb6176000/0xcf8485587b88ac71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc99d expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683666.623727:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176000, rc 0) 00000100:00100000:2.0:1789683666.623814:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+12:15014:x1876618835516288:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 182us (6552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683666.623822:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 140 00000100:00100000:3.0:1789683666.631749:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683666.633015:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835516416 00000100:00100000:0.0:1789683666.633029:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835516416 00000100:00100000:0.0:1789683666.633103:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 141 00000100:00100000:0.0:1789683666.633124:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+12:15014:x1876618835516416:12345-192.168.201.50@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789683666.633157:0:17194:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789683666.633199:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789683666.633203:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789683666.633206:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789683666.633208:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789683666.633210:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789683666.638193:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+12:15014:x1876618835516416:12345-192.168.201.50@tcp:256:mount.lustre.0 Request processed in 5047us (6431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683666.638210:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 141 00000100:00100000:1.0:1789683666.641413:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683666.641483:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835516544 00000100:00100000:2.0:1789683666.641494:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835516544 00000100:00100000:2.0:1789683666.641553:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 142 00000100:00100000:2.0:1789683666.641563:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7958450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+12:15014:x1876618835516544:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789683666.641580:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683666.641597:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88ac78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc9a4 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683666.641619:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88ac78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9a4 expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683666.641626:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88ac78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9a4 expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683666.641641:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176600, rc 0) 00000100:00100000:2.0:1789683666.641686:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7958450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:15014:x1876618835516544:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 124us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683666.641693:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 142 00000100:00100000:3.0:1789683666.647269:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683666.647391:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835516672 00000100:00100000:0.0:1789683666.647402:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835516672 00000100:00100000:0.0:1789683666.647549:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 143 00000100:00100000:0.0:1789683666.647571:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7959850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:15014:x1876618835516672:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789683666.647762:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7959850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:15014:x1876618835516672:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 193us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683666.647770:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 143 00000100:00100000:1.0:1789683666.652085:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683666.652188:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835516800 00000100:00100000:3.0:1789683666.652199:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835516800 00000100:00100000:3.0:1789683666.652261:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 144 00000100:00100000:3.0:1789683666.652271:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7959450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:15014:x1876618835516800:12345-192.168.201.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789683666.652667:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7959450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:15014:x1876618835516800:12345-192.168.201.50@tcp:503:mount.lustre.0 Request processed in 396us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683666.652676:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 144 00000100:00100000:1.0:1789683666.655471:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683666.656245:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835516928 00000100:00100000:2.0:1789683666.656256:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835516928 00000100:00100000:2.0:1789683666.656318:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 145 00000100:00100000:2.0:1789683666.656328:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7958c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:15026:x1876618835516928:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789683666.656558:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7958c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:15026:x1876618835516928:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 230us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683666.656566:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 145 00000100:00100000:1.0:1789683666.670909:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683666.671067:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835517056 00000100:00100000:0.0:1789683666.671078:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835517056 00000100:00100000:0.0:1789683666.671142:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 146 00000100:00100000:0.0:1789683666.671153:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:15026:x1876618835517056:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789683666.671327:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:15026:x1876618835517056:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 175us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683666.671336:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 146 00000100:00100000:1.0:1789683666.685874:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683666.686862:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683666.687419:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835517184 00000100:00100000:0.0:1789683666.687432:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835517184 00000100:00100000:0.0:1789683666.687493:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835517440 00000100:00100000:0.0:1789683666.687497:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835517440 00000100:00100000:0.0:1789683666.687525:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:0.0:1789683666.687534:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1876618835517184:12345-192.168.201.50@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789683666.687566:0:17202:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2@192.168.201.50@tcp t0 exp 0000000000000000 cur 580 last 0 00000020:00000080:0.0:1789683666.687603:0:17202:0:(genops.c:1384:class_connect()) connect: client 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2, cookie 0xcf8485587b88ac7f 00000004:00100000:0.0:1789683666.687640:0:17202:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1789683666.687734:0:17202:0:(import.c:65:import_set_state_nolock()) ffff9f0e82d54000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683666.687827:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:2401:x1876618835517184:12345-192.168.201.50@tcp:38:mount.lustre.0 Request processed in 291us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683666.687834:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:0.0:1789683666.687852:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:0.0:1789683666.687869:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1876618835517440:12345-192.168.201.50@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789683666.687896:0:17202:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2@192.168.201.50@tcp t0 exp 0000000000000000 cur 580 last 0 00000020:00000080:0.0:1789683666.687933:0:17202:0:(genops.c:1384:class_connect()) connect: client 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2, cookie 0xcf8485587b88ac86 00000004:00100000:0.0:1789683666.687946:0:17202:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1789683666.688044:0:17202:0:(import.c:65:import_set_state_nolock()) ffff9f0e82d51000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683666.688067:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:2401:x1876618835517440:12345-192.168.201.50@tcp:38:mount.lustre.0 Request processed in 198us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683666.688075:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:1.0:1789683666.708385:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683666.708426:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683666.708472:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683666.708562:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835517568 00000100:00100000:2.0:1789683666.708571:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835517568 00000100:00100000:2.0:1789683666.708664:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835517312 00000100:00100000:2.0:1789683666.708668:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835517312 00000100:00100000:2.0:1789683666.708684:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835517696 00000100:00100000:2.0:1789683666.708686:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835517696 00000100:00100000:2.0:1789683666.708700:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:2.0:1789683666.708709:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:0:x1876618835517568:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789683666.708741:0:17201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789683666.708842:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:0:x1876618835517568:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 132us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683666.708850:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:2.0:1789683666.708869:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:2.0:1789683666.708875:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+7:0:x1876618835517312:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789683666.708902:0:17201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789683666.708931:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+7:0:x1876618835517312:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 56us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683666.708937:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:2.0:1789683666.708950:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:2.0:1789683666.708957:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:15014:x1876618835517696:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789683666.708968:0:17201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789683666.708989:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:15014:x1876618835517696:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 32us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683666.708995:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00080000:1.0:1789683666.709779:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683666.709823:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683666.713128:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683666.713243:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835517824 00000100:00100000:2.0:1789683666.713254:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835517824 00000100:00100000:2.0:1789683666.713322:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:2.0:1789683666.713334:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:15014:x1876618835517824:12345-192.168.201.50@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789683666.713442:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:15014:x1876618835517824:12345-192.168.201.50@tcp:40:mount.lustre.0 Request processed in 110us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683666.713460:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:2.0:1789683666.724435:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683666.724673:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683666.724750:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683666.724849:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835518208 00000100:00100000:1.0:1789683666.724860:0:17211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835518208 00000100:00100000:1.0:1789683666.724926:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:1.0:1789683666.724937:0:17211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:15014:x1876618835518208:12345-192.168.201.50@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789683666.725021:0:17211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:15014:x1876618835518208:12345-192.168.201.50@tcp:900:mount.lustre.0 Request processed in 86us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683666.725029:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:3.0:1789683666.730175:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835517952 00000100:00100000:3.0:1789683666.730191:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835517952 00000100:00100000:3.0:1789683666.732060:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683666.732251:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835518336 00000100:00100000:2.0:1789683666.732261:0:17204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835518336 00000100:00100000:2.0:1789683666.732321:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:2.0:1789683666.732331:0:17204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:15014:x1876618835518336:12345-192.168.201.50@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789683666.732420:0:17204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789683666.732506:0:17204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:15014:x1876618835518336:12345-192.168.201.50@tcp:33:mount.lustre.0 Request processed in 175us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683666.732514:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:0.0:1789683666.733062:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835518080 00000100:00100000:0.0:1789683666.733070:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835518080 00000100:00100000:0.0:1789683666.733098:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:0.0:1789683666.733105:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1876618835517952:12345-192.168.201.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789683666.733137:0:18708:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2@192.168.201.50@tcp t0 exp 0000000000000000 cur 580 last 0 00000020:00000080:0.0:1789683666.733177:0:18708:0:(genops.c:1384:class_connect()) connect: client 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2, cookie 0xcf8485587b88ac8d 00002000:00100000:0.0:1789683666.733190:0:18708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2/ffff9f0e82d55000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789683666.733202:0:18708:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789683666.733294:0:18708:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789683666.733324:0:18708:0:(import.c:65:import_set_state_nolock()) ffff9f0e82d54800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683666.733368:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:2401:x1876618835517952:12345-192.168.201.50@tcp:8:mount.lustre.0 Request processed in 261us (8695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683666.733376:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:0.0:1789683666.733390:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:0.0:1789683666.733394:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1876618835518080:12345-192.168.201.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789683666.733411:0:18708:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2@192.168.201.50@tcp t0 exp 0000000000000000 cur 580 last 0 00000020:00000080:0.0:1789683666.733444:0:18708:0:(genops.c:1384:class_connect()) connect: client 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2, cookie 0xcf8485587b88ac94 00002000:00100000:0.0:1789683666.733450:0:18708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2/ffff9f0e82d57000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789683666.733457:0:18708:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789683666.733503:0:18708:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789683666.733520:0:18708:0:(import.c:65:import_set_state_nolock()) ffff9f0fa5320800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683666.733547:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:2401:x1876618835518080:12345-192.168.201.50@tcp:8:mount.lustre.0 Request processed in 150us (8796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683666.733553:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:3.0:1789683666.884746:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683666.884972:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835518464 00000100:00100000:1.0:1789683666.884984:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835518464 00000100:00100000:1.0:1789683666.885082:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:1.0:1789683666.885091:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:15049:x1876618835518464:12345-192.168.201.50@tcp:101:mkdir.0 00010000:00010000:1.0:1789683666.885110:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683666.885145:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da000/0xcf8485587b88ac9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc9d5 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683666.885251:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88aca2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683666.885266:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88aca2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683666.885280:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88aca2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683666.885324:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789683666.885328:0:17200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789683666.885350:0:17200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88aca2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683666.885377:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da000/0xcf8485587b88ac9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9d5 expref: 8 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683666.885397:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88aca2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9d5 expref: 7 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683666.885405:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f82a2bd00) 00010000:00010000:1.0:1789683666.885408:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683666.885412:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dbc00, rc 0) 00000100:00100000:1.0:1789683666.885562:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+7:15049:x1876618835518464:12345-192.168.201.50@tcp:101:mkdir.0 Request processed in 470us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683666.885569:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00000040:00080000:1.0:1789683666.976954:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789683667.487255:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683668.515188:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683668.575485:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850281472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683668.575581:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683668.575721:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683668.575730:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850281600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683668.575758:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683668.575819:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850281472 00000100:00100000:2.0:1789683668.575828:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850281472 00000100:00100000:2.0:1789683668.575873:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850281600 00000100:00100000:2.0:1789683668.575876:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850281600 00000100:00100000:2.0:1789683668.575895:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789683668.575903:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850281472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683668.575947:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789683668.575999:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850281472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683668.576026:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789683668.576044:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789683668.576050:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850281600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789683668.576060:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789683668.576084:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850281600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683668.576090:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1789683668.576118:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789683668.576161:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850281600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683668.576172:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789683668.576190:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850281472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683668.576931:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850282112:0@lo:400:kworker.0 00000100:00100000:1.0:1789683668.576985:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683668.577007:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850282624:0@lo:400:kworker.0 00000100:00100000:1.0:1789683668.577026:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683668.577047:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789683668.577053:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850281984:0@lo:400:kworker.0 00000100:00100000:1.0:1789683668.577074:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683668.577093:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850282496:0@lo:400:kworker.0 00000100:00100000:1.0:1789683668.577111:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683668.577127:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850283008:0@lo:400:kworker.0 00000100:00100000:1.0:1789683668.577162:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683668.577189:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850282112 00000100:00100000:1.0:1789683668.577195:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850282112 00000100:00100000:1.0:1789683668.577223:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850282624 00000100:00100000:1.0:1789683668.577226:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850282624 00000100:00100000:1.0:1789683668.577241:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850282496 00000100:00100000:1.0:1789683668.577244:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850282496 00000100:00100000:1.0:1789683668.577251:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850283008 00000100:00100000:1.0:1789683668.577254:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850283008 00000100:00100000:1.0:1789683668.577266:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789683668.577272:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850282112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683668.577328:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850282112:12345-0@lo:400:kworker.0 Request processed in 55us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683668.577334:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789683668.577361:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789683668.577368:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850282624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683668.577395:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850282624:12345-0@lo:400:kworker.0 Request processed in 28us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683668.577401:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789683668.577412:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789683668.577418:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850282496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683668.577444:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850282496:12345-0@lo:400:kworker.0 Request processed in 26us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683668.577449:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789683668.577461:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789683668.577468:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850283008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683668.577495:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850283008:12345-0@lo:400:kworker.0 Request processed in 28us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683668.577500:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789683668.577519:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850281984 00000100:00100000:1.0:1789683668.577522:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850281984 00000100:00100000:1.0:1789683668.577548:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789683668.577556:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850281984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683668.577585:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850281984:12345-0@lo:400:kworker.0 Request processed in 31us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683668.577591:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789683668.577630:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850281984:0@lo:400:kworker.0 00000100:00100000:1.0:1789683668.577641:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850282496:0@lo:400:kworker.0 00010000:00080000:1.0:1789683668.577650:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83fc4e00 x1876618850283008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683668.577666:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850283008:0@lo:400:kworker.0 00000100:00100000:1.0:1789683668.577676:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850282112:0@lo:400:kworker.0 00000100:00100000:1.0:1789683668.577684:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850282624:0@lo:400:kworker.0 00000100:00100000:2.0:1789683668.579554:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850281728:0@lo:400:kworker.0 00000100:00100000:2.0:1789683668.579685:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683668.579755:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850282240:0@lo:400:kworker.0 00000100:00100000:2.0:1789683668.579805:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683668.579829:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850282752:0@lo:400:kworker.0 00000100:00100000:2.0:1789683668.579852:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683668.579877:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789683668.579884:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850281856:0@lo:400:kworker.0 00000100:00100000:2.0:1789683668.579915:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683668.579933:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850282368:0@lo:400:kworker.0 00000100:00100000:2.0:1789683668.579958:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683668.579977:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850282880:0@lo:400:kworker.0 00000100:00100000:2.0:1789683668.580028:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683668.580059:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850282752 00000100:00100000:2.0:1789683668.580067:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850282752 00000100:00100000:2.0:1789683668.580111:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850282880 00000100:00100000:2.0:1789683668.580114:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850282880 00000100:00100000:2.0:1789683668.580143:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789683668.580152:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850282752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683668.580213:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850282752:12345-0@lo:400:kworker.0 Request processed in 62us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683668.580220:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789683668.580237:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789683668.580242:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850282880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683668.580268:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850282880:12345-0@lo:400:kworker.0 Request processed in 26us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683668.580273:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789683668.580290:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850282240 00000100:00100000:2.0:1789683668.580293:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850282240 00000100:00100000:2.0:1789683668.580329:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850281856 00000100:00100000:2.0:1789683668.580333:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850281856 00000100:00100000:2.0:1789683668.580346:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789683668.580351:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850282240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683668.580382:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850282240:12345-0@lo:400:kworker.0 Request processed in 31us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683668.580388:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789683668.580398:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789683668.580404:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850281856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683668.580447:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850281856:12345-0@lo:400:kworker.0 Request processed in 43us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683668.580462:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789683668.580480:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850282368 00000100:00100000:2.0:1789683668.580483:0:18710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850282368 00000100:00100000:2.0:1789683668.580512:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789683668.580519:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850282368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683668.580549:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850282368:12345-0@lo:400:kworker.0 Request processed in 31us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683668.580555:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789683668.580576:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789683668.580581:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789683668.580584:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683668.580618:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850281856:0@lo:400:kworker.0 00000100:00100000:2.0:1789683668.580629:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850282368:0@lo:400:kworker.0 00000100:00100000:2.0:1789683668.580639:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850282880:0@lo:400:kworker.0 00000100:00100000:2.0:1789683668.580648:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850282240:0@lo:400:kworker.0 00010000:00080000:2.0:1789683668.580659:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e82fe7800 x1876618850282752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683668.580668:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850282752:0@lo:400:kworker.0 00000100:00100000:1.0:1789683668.581778:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850281728 00000100:00100000:1.0:1789683668.582276:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850281728 00000100:00100000:1.0:1789683668.582482:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789683668.582493:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb795ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3647:x1876618850281728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683668.582586:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb795ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3647:x1876618850281728:12345-0@lo:400:kworker.0 Request processed in 96us (2901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683668.582593:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789683668.582734:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850281728:0@lo:400:kworker.0 00000001:00100000:3.0:1789683669.090995:0:17933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2 00000001:00100000:3.0:1789683669.091009:0:17933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1acf7a90-98f6-4b44-899e-7c61b5867591 00000001:00100000:0.0:1789683669.091477:0:18704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2 00000001:00100000:0.0:1789683669.091484:0:18704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1acf7a90-98f6-4b44-899e-7c61b5867591 00000001:00100000:2.0:1789683669.091652:0:17180:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2 00000001:00100000:2.0:1789683669.091660:0:17180:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1acf7a90-98f6-4b44-899e-7c61b5867591 00010000:00010000:0.0:1789683669.542821:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789683670.193946:0:20080:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789683670.560242:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683670.623520:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683670.623570:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850283136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683670.623642:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683670.624009:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683670.624020:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850283264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683670.624064:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683670.624237:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850283264 00000100:00100000:3.0:1789683670.624247:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850283264 00000100:00100000:3.0:1789683670.624319:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789683670.624331:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850283264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789683670.624362:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789683670.624412:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850283264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683670.624419:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789683670.624471:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850283264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683670.624646:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850283136 00000100:00100000:0.0:1789683670.624651:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850283136 00000100:00100000:0.0:1789683670.624680:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789683670.624687:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850283136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789683670.624711:0:17941:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789683670.624751:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850283136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683670.624757:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789683670.624916:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850283136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683670.625318:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850283392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683670.625354:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683670.625472:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850283392 00000100:00100000:2.0:1789683670.625488:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850283392 00000100:00100000:2.0:1789683670.625525:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789683670.625532:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850283392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789683670.625553:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789683670.625608:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850283392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683670.625615:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789683670.625743:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850283392:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1789683670.626690:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1789683671.332926:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789683671.585155:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683671.647719:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e8451ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850283520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683671.649177:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683671.650211:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850283520 00000100:00100000:3.0:1789683671.650223:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850283520 00000100:00100000:3.0:1789683671.650301:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683671.650312:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850283520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683671.650340:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789683671.650411:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850283520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683671.650418:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683671.650474:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e8451ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850283520:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789683671.651002:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683672.097137:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683672.097172:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683672.097197:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683672.097221:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683672.097242:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683672.097267:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683672.097292:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683672.097312:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683672.097345:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683672.097380:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835518592 00000100:00100000:2.0:1789683672.097393:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835518592 00000100:00100000:2.0:1789683672.097460:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 148 00000100:00100000:2.0:1789683672.097475:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7959050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:2402:x1876618835518592:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683672.097554:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7959050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:2402:x1876618835518592:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 84us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683672.097561:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 148 00000100:00100000:2.0:1789683672.097597:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835518848 00000100:00100000:2.0:1789683672.097601:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835518848 00000100:00100000:2.0:1789683672.097643:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835519360 00000100:00100000:2.0:1789683672.097647:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835519360 00000100:00100000:2.0:1789683672.097660:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835518720 00000100:00100000:2.0:1789683672.097663:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835518720 00000100:00100000:2.0:1789683672.097675:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835519232 00000100:00100000:2.0:1789683672.097677:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835519232 00000100:00100000:2.0:1789683672.097692:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 51 00000100:00100000:2.0:1789683672.097699:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2402:x1876618835518848:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683672.097731:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2402:x1876618835518848:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 33us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683672.097738:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 51 00000100:00100000:2.0:1789683672.097751:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:2.0:1789683672.097756:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2402:x1876618835519360:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683672.097780:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2402:x1876618835519360:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 23us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683672.097812:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:2.0:1789683672.097824:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:2.0:1789683672.097831:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+6:2402:x1876618835518720:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683672.097855:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+6:2402:x1876618835518720:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683672.097861:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:2.0:1789683672.098020:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:2.0:1789683672.098028:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:2402:x1876618835519232:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683672.098055:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:2402:x1876618835519232:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 28us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683672.098082:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:2.0:1789683672.098103:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835519104 00000100:00100000:2.0:1789683672.098107:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835519104 00000100:00100000:2.0:1789683672.098127:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835519616 00000100:00100000:2.0:1789683672.098130:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835519616 00000100:00100000:2.0:1789683672.098139:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835518976 00000100:00100000:2.0:1789683672.098141:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835518976 00000100:00100000:2.0:1789683672.098150:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835519488 00000100:00100000:2.0:1789683672.098152:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835519488 00000100:00100000:2.0:1789683672.098162:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:2.0:1789683672.098167:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2402:x1876618835519104:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683672.098192:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2402:x1876618835519104:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683672.098197:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:2.0:1789683672.098207:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:2.0:1789683672.098212:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:2402:x1876618835519616:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683672.098230:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:2402:x1876618835519616:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 19us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683672.098235:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:2.0:1789683672.098244:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:2.0:1789683672.098249:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2402:x1876618835518976:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683672.098266:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2402:x1876618835518976:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 18us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683672.098272:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:2.0:1789683672.098281:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:2.0:1789683672.098294:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2402:x1876618835519488:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683672.098314:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2402:x1876618835519488:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 21us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683672.098319:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00080000:2.0:1789683672.098516:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789683672.098520:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683672.098523:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683672.098525:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789683672.610112:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789683672.680870:0:19524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8ad19e05-bbf9-4d06-b3fa-15d4caed94e2 00010000:00010000:2.0:1789683673.637396:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683673.697031:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850283648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683673.697145:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683673.697301:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850283648 00000100:00100000:2.0:1789683673.697310:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850283648 00000100:00100000:2.0:1789683673.697373:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789683673.697384:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850283648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789683673.697415:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789683673.697476:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850283648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683673.697484:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789683673.697535:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850283776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683673.697567:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789683673.697655:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683673.697840:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3648:1876618850283904:0@lo:400:kworker.0 00000100:00100000:3.0:1789683673.697876:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683673.697898:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850284416:0@lo:400:kworker.0 00000100:00100000:3.0:1789683673.697923:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683673.697943:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850284928:0@lo:400:kworker.0 00000100:00100000:3.0:1789683673.697965:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683673.697986:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789683673.697993:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850284288:0@lo:400:kworker.0 00000100:00100000:3.0:1789683673.698014:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683673.698031:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850284800:0@lo:400:kworker.0 00000100:00100000:3.0:1789683673.698065:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683673.698103:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850284416 00000100:00100000:3.0:1789683673.698107:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850284416 00000100:00100000:3.0:1789683673.698141:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789683673.698148:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850284416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683673.698190:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850284416:12345-0@lo:400:kworker.0 Request processed in 43us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683673.698196:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789683673.698214:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850284928 00000100:00100000:3.0:1789683673.698218:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850284928 00000100:00100000:3.0:1789683673.698249:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850284288 00000100:00100000:3.0:1789683673.698252:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850284288 00000100:00100000:3.0:1789683673.698263:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850284800 00000100:00100000:3.0:1789683673.698272:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850284800 00000100:00100000:3.0:1789683673.698291:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789683673.698297:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850284928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683673.698311:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850283776 00000100:00100000:2.0:1789683673.698315:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850283776 00000100:00100000:3.0:1789683673.698328:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876618850284928:12345-0@lo:400:kworker.0 Request processed in 31us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683673.698334:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789683673.698337:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789683673.698343:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789683673.698343:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850283776:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683673.698348:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850284288:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1789683673.698353:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789683673.698374:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850284288:12345-0@lo:400:kworker.0 Request processed in 25us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683673.698374:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850283776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683673.698381:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789683673.698381:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789683673.698392:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789683673.698397:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850284800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683673.698424:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850284800:12345-0@lo:400:kworker.0 Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683673.698430:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1789683673.698457:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789683673.698460:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683673.698462:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789683673.698474:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850284160:0@lo:400:kworker.0 00000100:00100000:3.0:1789683673.698501:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683673.698528:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850284672:0@lo:400:kworker.0 00000100:00100000:3.0:1789683673.698546:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683673.698560:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850285184:0@lo:400:kworker.0 00000100:00100000:3.0:1789683673.698578:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683673.698614:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850284160 00000100:00100000:3.0:1789683673.698615:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850283648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789683673.698618:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850284160 00000100:00100000:3.0:1789683673.698637:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789683673.698644:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850284032:0@lo:400:kworker.0 00000100:00100000:2.0:1789683673.698655:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789683673.698661:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850284160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683673.698666:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683673.698681:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850284544:0@lo:400:kworker.0 00000100:00100000:2.0:1789683673.698688:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850284160:12345-0@lo:400:kworker.0 Request processed in 28us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683673.698693:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789683673.698699:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683673.698759:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850283904 00000100:00100000:1.0:1789683673.698764:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850283904 00000100:00100000:1.0:1789683673.698813:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789683673.698821:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3648:x1876618850283904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683673.698856:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3648:x1876618850283904:12345-0@lo:400:kworker.0 Request processed in 37us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683673.698862:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789683673.698954:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850285056:0@lo:400:kworker.0 00000100:00100000:3.0:1789683673.698982:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683673.699006:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850284160:0@lo:400:kworker.0 00000100:00100000:1.0:1789683673.699074:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850284672 00000100:00100000:1.0:1789683673.699084:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850284672 00000100:00100000:1.0:1789683673.699108:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850285184 00000100:00100000:1.0:1789683673.699111:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850285184 00000100:00100000:1.0:1789683673.699127:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850285056 00000100:00100000:1.0:1789683673.699129:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850285056 00000100:00100000:1.0:1789683673.699144:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789683673.699150:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850284672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683673.699187:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850284672:12345-0@lo:400:kworker.0 Request processed in 37us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683673.699193:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789683673.699205:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789683673.699211:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850285184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683673.699238:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850285184:12345-0@lo:400:kworker.0 Request processed in 28us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683673.699244:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789683673.699256:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789683673.699262:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850285056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683673.699288:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876618850285056:12345-0@lo:400:kworker.0 Request processed in 27us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683673.699294:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789683673.699373:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850284032 00000100:00100000:0.0:1789683673.699383:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850284032 00000100:00100000:0.0:1789683673.699424:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789683673.699431:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850284032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683673.699467:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850284032:12345-0@lo:400:kworker.0 Request processed in 36us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683673.699472:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789683673.699511:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850283776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683673.701368:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850284288:0@lo:400:kworker.0 00000100:00100000:0.0:1789683673.701389:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850284800:0@lo:400:kworker.0 00000100:00100000:0.0:1789683673.701400:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3648:1876618850283904:0@lo:400:kworker.0 00000100:00100000:0.0:1789683673.701412:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850284416:0@lo:400:kworker.0 00010000:00080000:0.0:1789683673.701425:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7d62300 x1876618850284928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683673.701437:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1876618850284928:0@lo:400:kworker.0 00000100:00100000:2.0:1789683673.705717:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850284544 00000100:00100000:2.0:1789683673.705736:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850284544 00000100:00100000:2.0:1789683673.705870:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789683673.705882:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850284544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683673.705990:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850284544:12345-0@lo:400:kworker.0 Request processed in 110us (7289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683673.705998:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789683673.708417:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683673.708429:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789683673.708432:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683673.708495:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850284032:0@lo:400:kworker.0 00000100:00100000:3.0:1789683673.708514:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850284544:0@lo:400:kworker.0 00000100:00100000:3.0:1789683673.708525:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1876618850285056:0@lo:400:kworker.0 00000100:00100000:3.0:1789683673.708536:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850284672:0@lo:400:kworker.0 00010000:00080000:3.0:1789683673.708550:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fa7d60e00 x1876618850285184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683673.708560:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850285184:0@lo:400:kworker.0 00010000:00010000:0.0:1789683674.665103:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789683674.886213:0:20228:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4fd7c6b0 20000000:00000080:3.0:1789683674.886235:0:20228:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0fa7de5400 uarg=0000000000000000 20000000:01000000:3.0:1789683674.886279:0:20228:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789683674.886285:0:20228:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789683674.886290:0:20228:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789683674.888576:0:20229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1789683674.888891:0:20228:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789683674.897581:0:20228:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789683674.897613:0:20228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88aca9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.897633:0:20228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f8454d400/0xcf8485587b88a93e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a937 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.897641:0:20228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fb6177200/0xcf8485587b88a94c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a945 expref: 23 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.897649:0:20228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fa01f8800/0xcf8485587b88a98b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88a984 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.897656:0:20228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f81677200/0xcf8485587b88aae9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88aae2 expref: 23 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.897666:0:20228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0f81677800/0xcf8485587b88ac39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc934 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.897674:0:20228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88ac78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9a4 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.897680:0:20228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88aca9 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.897726:0:20228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88ac78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9a4 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.897743:0:20228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88ac78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9a4 expref: 12 pid: 17193 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683674.897757:0:20228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d60e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20228:1876618850285312:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789683674.897934:0:20228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f81677800/0xcf8485587b88ac39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc934 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.897942:0:20228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0f81677800/0xcf8485587b88ac39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc934 expref: 12 pid: 17194 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683674.897951:0:20228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d60380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20228:1876618850285440:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789683674.897981:0:20228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f81677200/0xcf8485587b88aae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88aae2 expref: 23 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.897989:0:20228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0f81677200/0xcf8485587b88aae9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88aae2 expref: 23 pid: 17195 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683674.897998:0:20228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d61180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20228:1876618850285568:0@lo:104: 00000100:00100000:3.0:1789683674.898049:0:20228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789683674.898083:0:20228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fa01f8800/0xcf8485587b88a98b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88a984 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.898091:0:20228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0fa01f8800/0xcf8485587b88a98b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88a984 expref: 23 pid: 17193 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683674.898099:0:20228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d62680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20228:1876618850285696:0@lo:104: 00000100:00100000:3.0:1789683674.898121:0:20228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683674.898171:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850285568 00000100:00100000:3.0:1789683674.898179:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850285568 00000100:00100000:3.0:1789683674.898217:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850285696 00000100:00100000:3.0:1789683674.898221:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850285696 00000100:00100000:3.0:1789683674.898234:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789683674.898242:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+4:20228:x1876618850285568:12345-0@lo:104: 00010000:00010000:3.0:1789683674.898267:0:17184:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0e837dba00/0xcf8485587b88aae2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88aae9 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.898312:0:17184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789683674.898317:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+4:20228:x1876618850285568:12345-0@lo:104: Request processed in 76us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683674.898325:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789683674.898342:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789683674.898350:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+3:20228:x1876618850285696:12345-0@lo:104: 00010000:00010000:3.0:1789683674.898357:0:17184:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88a984 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a98b expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.898384:0:17184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789683674.898389:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+3:20228:x1876618850285696:12345-0@lo:104: Request processed in 41us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683674.898394:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789683674.898427:0:20228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0fb6177200/0xcf8485587b88a94c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88a945 expref: 23 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.898435:0:20228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0fb6177200/0xcf8485587b88a94c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88a945 expref: 23 pid: 17195 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683674.898444:0:20228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d61500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20228:1876618850285824:0@lo:104: 00000100:00100000:3.0:1789683674.898466:0:20228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683674.898487:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850285824 00000100:00100000:3.0:1789683674.898491:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850285824 00000100:00100000:3.0:1789683674.898509:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683674.898515:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+3:20228:x1876618850285824:12345-0@lo:104: 00010000:00010000:3.0:1789683674.898530:0:17184:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ce00/0xcf8485587b88a945 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a94c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.898558:0:17184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789683674.898562:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+3:20228:x1876618850285824:12345-0@lo:104: Request processed in 48us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683674.898569:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789683674.898598:0:20228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0f8454d400/0xcf8485587b88a93e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf8485587b88a937 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.898607:0:20228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0f8454d400/0xcf8485587b88a93e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf8485587b88a937 expref: 23 pid: 17194 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683674.898615:0:20228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20228:1876618850285952:0@lo:104: 00000100:00100000:3.0:1789683674.898640:0:20228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683674.898658:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850285952 00000100:00100000:3.0:1789683674.898661:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850285952 00000100:00100000:3.0:1789683674.898679:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789683674.898684:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+3:20228:x1876618850285952:12345-0@lo:104: 00010000:00010000:3.0:1789683674.898691:0:17184:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88a937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a93e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.898723:0:17184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789683674.898727:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+3:20228:x1876618850285952:12345-0@lo:104: Request processed in 44us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683674.898732:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789683674.898750:0:20228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb85c9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683674.898770:0:20228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d61180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20228:1876618850285568:0@lo:104: 00000100:00100000:3.0:1789683674.898826:0:20228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d62680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20228:1876618850285696:0@lo:104: 00000100:00100000:3.0:1789683674.898834:0:20228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d61500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20228:1876618850285824:0@lo:104: 00000100:00100000:3.0:1789683674.898840:0:20228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20228:1876618850285952:0@lo:104: 00010000:00010000:2.0:1789683674.899164:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789683674.899173:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0e837dba00/0xcf8485587b88aae2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88aae9 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899179:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dba00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683674.899183:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837dba00/0xcf8485587b88aae2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88aae9 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899192:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0e837dba00/0xcf8485587b88aae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88aae9 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683674.899198:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837dba00/0xcf8485587b88aae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88aae9 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683674.899203:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789683674.899238:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0e837dba00/0xcf8485587b88aae2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88aae9 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899253:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683674.899271:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0e837dba00/0xcf8485587b88aae2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88aae9 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899277:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0e837dba00/0xcf8485587b88aae2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88aae9 expref: -99 pid: 19523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899290:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789683674.899293:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88a984 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a98b expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899298:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837db200 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683674.899301:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88a984 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88a98b expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899307:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88a984 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88a98b expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683674.899312:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88a984 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88a98b expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683674.899318:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789683674.899331:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88a984 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a98b expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899337:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683674.899343:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88a984 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a98b expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899349:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88a984 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a98b expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899365:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683674.899368:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ce00/0xcf8485587b88a945 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a94c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899373:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454ce00 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683674.899375:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ce00/0xcf8485587b88a945 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88a94c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899382:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ce00/0xcf8485587b88a945 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88a94c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683674.899388:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ce00/0xcf8485587b88a945 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88a94c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683674.899393:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789683674.899406:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ce00/0xcf8485587b88a945 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a94c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899411:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683674.899430:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ce00/0xcf8485587b88a945 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a94c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899437:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0f8454ce00/0xcf8485587b88a945 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a94c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899446:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683674.899449:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88a937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf8485587b88a93e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899466:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176800 already unused, calling callback (ffffffffc11d4c20) 10000000:00010000:2.0:1789683674.899469:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88a937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf8485587b88a93e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899476:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88a937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf8485587b88a93e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683674.899481:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88a937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf8485587b88a93e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683674.899486:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789683674.899500:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88a937 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a93e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899506:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683674.899513:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88a937 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a93e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899518:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88a937 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf8485587b88a93e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899530:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683674.899532:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683674.899533:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683674.899545:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3649:1876618850286336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683674.899582:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683674.899634:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683674.899640:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3649:1876618850286464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683674.899672:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683674.899712:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850286336 00000100:00100000:2.0:1789683674.899717:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850286336 00010000:00010000:2.0:1789683674.899738:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fb6177200/0xcf8485587b88a94c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a945 expref: 24 pid: 17195 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683674.899758:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850286464 00000100:00100000:2.0:1789683674.899761:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850286464 00010000:00010000:2.0:1789683674.899772:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f8454d400/0xcf8485587b88a93e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a937 expref: 25 pid: 17194 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683674.899815:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789683674.899824:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+25:3649:x1876618850286336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683674.899837:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683674.899842:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fb6177200/0xcf8485587b88a94c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a945 expref: 25 pid: 17195 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899852:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fb6177200/0xcf8485587b88a94c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88a945 expref: 25 pid: 17195 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899866:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb6177200/0xcf8485587b88a94c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88a945 expref: 25 pid: 17195 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899879:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683674.899912:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3649:x1876618850286336:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683674.899919:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789683674.899935:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789683674.899942:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:3649:x1876618850286464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683674.899959:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683674.899963:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f8454d400/0xcf8485587b88a93e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a937 expref: 23 pid: 17194 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899972:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f8454d400/0xcf8485587b88a93e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88a937 expref: 23 pid: 17194 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899981:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f8454d400/0xcf8485587b88a93e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88a937 expref: 23 pid: 17194 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.899991:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683674.900015:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:3649:x1876618850286464:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683674.900033:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789683674.900069:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3649:1876618850286464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683674.900077:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3649:1876618850286336:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683674.900287:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683674.900298:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850286080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683674.900327:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683674.900356:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683674.900361:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850286208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683674.900379:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683674.900406:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850286080 00000100:00100000:0.0:1789683674.900410:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850286080 00010000:00010000:0.0:1789683674.900434:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f81677200/0xcf8485587b88aae9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88aae2 expref: 22 pid: 17195 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683674.900453:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850286208 00000100:00100000:0.0:1789683674.900456:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850286208 00010000:00010000:0.0:1789683674.900467:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fa01f8800/0xcf8485587b88a98b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a984 expref: 23 pid: 17193 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683674.900479:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789683674.900485:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:3647:x1876618850286080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683674.900493:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683674.900497:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f81677200/0xcf8485587b88aae9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88aae2 expref: 23 pid: 17195 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683674.900506:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f81677200/0xcf8485587b88aae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88aae2 expref: 23 pid: 17195 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683674.900517:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81677200/0xcf8485587b88aae9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88aae2 expref: 23 pid: 17195 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683674.900527:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683674.900557:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:3647:x1876618850286080:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683674.900563:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789683674.900576:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789683674.900596:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:3647:x1876618850286208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683674.900605:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683674.900610:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fa01f8800/0xcf8485587b88a98b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf8485587b88a984 expref: 21 pid: 17193 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683674.900629:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fa01f8800/0xcf8485587b88a98b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf8485587b88a984 expref: 21 pid: 17193 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683674.900638:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fa01f8800/0xcf8485587b88a98b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf8485587b88a984 expref: 21 pid: 17193 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683674.900646:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683674.900668:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+20:3647:x1876618850286208:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683674.900674:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789683674.900704:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850286208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683674.900711:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3647:1876618850286080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683674.922432:0:20228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d60e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20228:1876618850285312:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789683674.922598:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683674.922832:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683674.922897:0:20228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d60380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20228:1876618850285440:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789683674.922940:0:20228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88aca9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683674.925698:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835519744 00000100:00100000:0.0:1789683674.925716:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835519744 00010000:00010000:0.0:1789683674.925774:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88ac78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9a4 expref: 13 pid: 17193 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683674.926621:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835519872 00000100:00100000:0.0:1789683674.926628:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835519872 00010000:00010000:0.0:1789683674.926653:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0f81677800/0xcf8485587b88ac39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc934 expref: 14 pid: 17194 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683674.926738:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:2.0:1789683674.926751:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f8a3ac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+14:2403:x1876618835519744:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683674.926768:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683674.926775:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88ac78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9a4 expref: 14 pid: 17193 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.926802:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88ac78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9a4 expref: 14 pid: 17193 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.926818:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0fb6176600/0xcf8485587b88ac78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9a4 expref: 14 pid: 17193 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.926856:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683674.926932:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f8a3ac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:2403:x1876618835519744:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 183us (4346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683674.926939:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:2.0:1789683674.926988:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:2.0:1789683674.926995:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+12:2402:x1876618835519872:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683674.927003:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683674.927007:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0f81677800/0xcf8485587b88ac39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc934 expref: 12 pid: 17194 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.927016:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0f81677800/0xcf8485587b88ac39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc934 expref: 12 pid: 17194 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.927040:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81677800/0xcf8485587b88ac39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc934 expref: 12 pid: 17194 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.927052:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88aca9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.927059:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88aca9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.927076:0:17186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88aca9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.927084:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88aca9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.927101:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88aca9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.927107:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88aca9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.927114:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677e00 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683674.927118:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88aca9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.927127:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88aca9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.927144:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88aca9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683674.927156:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683674.927179:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+11:2402:x1876618835519872:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 185us (4348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683674.927185:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 14 00010000:00010000:3.0:1789683674.936370:0:20228:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88aca9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.936395:0:20228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88aca9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683674.936416:0:20228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88aca9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683675.679215:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683675.745528:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850286592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683675.745619:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683675.745668:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850286720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789683675.749333:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850286592 00000100:00100000:2.0:1789683675.749347:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850286592 00000100:00080000:0.0:1789683675.749453:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683675.749673:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789683675.749693:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850286592:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789683675.749709:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789683675.749750:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789683675.749940:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850286592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 255us (4322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683675.750235:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789683675.750274:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850286848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789683675.750318:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683675.754867:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850286592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683675.767293:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850286720 00000100:00100000:1.0:1789683675.767304:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850286848 00000100:00100000:0.0:1789683675.767310:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850286720 00000100:00100000:1.0:1789683675.767320:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850286848 00000100:00100000:1.0:1789683675.769380:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789683675.769395:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850286848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683675.769445:0:17941:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789683675.769591:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850286848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 200us (19271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683675.769677:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850286848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789683675.773527:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789683675.778988:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789683675.779024:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850286720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789683675.779065:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789683675.779247:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850286720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 245us (29552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683675.779258:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789683675.779356:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850286720:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789683676.192245:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789683676.706397:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683676.773158:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850286976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683676.773269:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683676.773438:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850286976 00000100:00100000:3.0:1789683676.773508:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850286976 00000100:00080000:2.0:1789683676.773836:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683676.773884:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789683676.773897:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850286976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683676.773924:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789683676.774614:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850286976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 718us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683676.774623:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789683676.778091:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850286976:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1789683676.895035:0:17197:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789683676.895044:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0f8721b000 from 13 10000000:01000000:1.0:1789683676.895050:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789683676.895105:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837db000/0xcf8485587b88acb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683676.895117:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0e837db000/0xcf8485587b88acb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683676.895129:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0e837db000/0xcf8485587b88acb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683676.895156:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850287104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789683676.895287:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683676.895332:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc151fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683676.895477:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850287104 00000100:00100000:2.0:1789683676.895485:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850287104 00000100:00100000:2.0:1789683676.895541:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789683676.895551:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7958850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+20:17197:x1876618850287104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683676.895565:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683676.895582:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0fb6176a00/0xcf8485587b88acb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88acb0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683676.895604:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0fb6176a00/0xcf8485587b88acb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88acb0 expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683676.895615:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0fb6176a00/0xcf8485587b88acb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88acb0 expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683676.895624:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6176a00, rc 0) 00000100:00100000:2.0:1789683676.895674:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7958850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:17197:x1876618850287104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683676.895681:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789683676.895949:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850287104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683676.895964:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0e837db000/0xcf8485587b88acb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88acb7 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683676.895972:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0e837db000/0xcf8485587b88acb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88acb7 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683676.896058:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850287232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683676.896085:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683676.896113:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 11 seconds 00000100:00100000:2.0:1789683676.896310:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850287232 00000100:00100000:2.0:1789683676.896315:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850287232 00000100:00100000:2.0:1789683676.896351:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789683676.896359:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:17197:x1876618850287232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683676.896485:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:17197:x1876618850287232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683676.896491:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789683676.896674:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850287232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683676.896702:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850287360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683676.896745:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683676.896768:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f9053f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789683676.896863:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850287360 00000100:00100000:1.0:1789683676.896867:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850287360 00000100:00100000:1.0:1789683676.896901:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789683676.896909:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:17197:x1876618850287360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683676.897001:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:17197:x1876618850287360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683676.897017:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789683676.897061:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850287360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789683676.897993:0:20296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789683676.903020:0:17197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789683676.903052:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683676.903065:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837db000/0xcf8485587b88acb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88acb7 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683676.903078:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0e837db000/0xcf8485587b88acb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88acb7 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683676.903090:0:17197:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789683676.903093:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0fc06b1000 from 13 10000000:01000000:2.0:1789683676.903095:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683676.903139:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88acbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683676.903146:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88acbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683676.903156:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88acbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683676.903182:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850287488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683676.903254:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683676.903317:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb85c9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789683676.903717:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850287488 00000100:00100000:1.0:1789683676.903726:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850287488 00000100:00100000:1.0:1789683676.903780:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789683676.903826:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+21:17197:x1876618850287488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683676.903841:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683676.903854:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837db600/0xcf8485587b88acc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88acbe expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683676.903878:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837db600/0xcf8485587b88acc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88acbe expref: 22 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683676.903888:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837db600/0xcf8485587b88acc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88acbe expref: 22 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683676.903896:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837db600, rc 0) 00000100:00100000:1.0:1789683676.903948:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:17197:x1876618850287488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683676.903954:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789683676.904017:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850287488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683676.904030:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88acbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88acc5 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683676.904039:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88acbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88acc5 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683676.904099:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850287616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683676.904127:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683676.904144:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc0775f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683676.904165:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850287616 00000100:00100000:1.0:1789683676.904170:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850287616 00000100:00100000:1.0:1789683676.904195:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789683676.904201:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:17197:x1876618850287616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683676.904326:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:17197:x1876618850287616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683676.904333:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789683676.904366:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850287616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683676.904394:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850287744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683676.904436:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683676.905684:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850287744 00000100:00100000:3.0:1789683676.905695:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850287744 00000100:00100000:3.0:1789683676.905746:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789683676.905756:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:17197:x1876618850287744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683676.905921:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:17197:x1876618850287744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683676.905929:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789683676.906379:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8b80b300 going to sleep for 11 seconds 00000100:00100000:1.0:1789683676.906405:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850287744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789683676.910587:0:20297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789683676.911166:0:17197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789683676.911195:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789683676.911207:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88acbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88acc5 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683676.911219:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb6176800/0xcf8485587b88acbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88acc5 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683676.911230:0:17197:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789683676.911233:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0fc04cf800 from 13 10000000:01000000:1.0:1789683676.911236:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789683676.911277:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88accc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683676.911285:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88accc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683676.911318:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88accc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683676.911346:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850287872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789683676.911423:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683676.911476:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc0775f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683676.918053:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850287872 00000100:00100000:3.0:1789683676.918071:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850287872 00000100:00100000:3.0:1789683676.918155:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789683676.918167:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+22:17197:x1876618850287872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683676.918188:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683676.918210:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88acd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88accc expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683676.918243:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88acd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88accc expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683676.918254:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81677e00/0xcf8485587b88acd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88accc expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683676.918262:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81677e00, rc 0) 00000100:00100000:3.0:1789683676.918357:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:17197:x1876618850287872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (6933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683676.918364:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789683676.918868:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850287872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683676.918890:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88accc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88acd3 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683676.918901:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88accc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88acd3 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683676.918979:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850288000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683676.919393:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683676.919430:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb85c9840 going to sleep for 11 seconds 00000100:00100000:1.0:1789683676.919590:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850288000 00000100:00100000:1.0:1789683676.919597:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850288000 00000100:00100000:1.0:1789683676.919633:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789683676.919641:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:17197:x1876618850288000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683676.919764:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:17197:x1876618850288000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683676.919771:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789683676.919853:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850288000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683676.919889:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850288128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683676.919937:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683676.919955:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc0775f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683676.919966:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850288128 00000100:00100000:1.0:1789683676.919969:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850288128 00000100:00100000:1.0:1789683676.919997:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789683676.920013:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:17197:x1876618850288128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683676.920090:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:17197:x1876618850288128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683676.920096:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789683676.920146:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850288128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789683676.924624:0:20298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789683676.926876:0:17197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789683676.926912:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683676.926925:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88accc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88acd3 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683676.926938:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0e837db200/0xcf8485587b88accc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88acd3 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683676.926949:0:17197:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789683676.926952:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0e83ec0800 from 13 10000000:01000000:2.0:1789683676.926955:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683676.927020:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177200/0xcf8485587b88acda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683676.927029:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177200/0xcf8485587b88acda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683676.927041:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177200/0xcf8485587b88acda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683676.927093:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850288256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683676.927170:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683676.927212:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb85c9600 going to sleep for 11 seconds 00000100:00100000:1.0:1789683676.928957:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850288256 00000100:00100000:1.0:1789683676.928974:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850288256 00000100:00100000:1.0:1789683676.929064:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789683676.929073:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+23:17197:x1876618850288256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683676.929089:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683676.929107:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837da000/0xcf8485587b88ace1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf8485587b88acda expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683676.929135:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837da000/0xcf8485587b88ace1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf8485587b88acda expref: 24 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683676.929145:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837da000/0xcf8485587b88ace1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf8485587b88acda expref: 24 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683676.929155:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da000, rc 0) 00000100:00100000:1.0:1789683676.929233:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:17197:x1876618850288256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (2063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683676.929239:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789683676.931423:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850288256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683676.931464:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177200/0xcf8485587b88acda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88ace1 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683676.931477:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177200/0xcf8485587b88acda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf8485587b88ace1 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683676.931590:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850288384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683676.931651:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683676.931697:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f88102900 going to sleep for 11 seconds 00000100:00100000:1.0:1789683676.932008:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850288384 00000100:00100000:1.0:1789683676.932015:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850288384 00000100:00100000:1.0:1789683676.932074:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789683676.932084:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:17197:x1876618850288384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683676.932231:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:17197:x1876618850288384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683676.932239:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789683676.933799:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850288384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683676.933869:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb79b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850288512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683676.933944:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683676.933978:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f86544780 going to sleep for 11 seconds 00000100:00100000:1.0:1789683676.934482:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850288512 00000100:00100000:1.0:1789683676.934498:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850288512 00000100:00100000:1.0:1789683676.934551:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789683676.934561:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:17197:x1876618850288512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683676.934676:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:17197:x1876618850288512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683676.934685:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789683676.935047:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb79b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:17197:1876618850288512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789683676.936344:0:20299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789683676.936542:0:17197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789683676.936564:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789683676.936575:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177200/0xcf8485587b88acda lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88ace1 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683676.936586:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff9f0fb6177200/0xcf8485587b88acda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf8485587b88ace1 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683676.964394:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683676.964478:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835520000 00000100:00100000:1.0:1789683676.964488:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835520000 00000100:00100000:1.0:1789683676.964543:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 162 00000100:00100000:1.0:1789683676.964553:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+11:14900:x1876618835520000:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683676.964572:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683676.964590:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0e837daa00/0xcf8485587b88ace8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc9dc expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683676.964620:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0e837daa00/0xcf8485587b88ace8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9dc expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683676.964631:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0e837daa00/0xcf8485587b88ace8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9dc expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683676.964641:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837daa00, rc 0) 00000100:00100000:1.0:1789683676.964704:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+12:14900:x1876618835520000:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 Request processed in 152us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683676.964711:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 162 00000100:00100000:1.0:1789683676.966646:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683676.966813:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835520128 00000100:00100000:3.0:1789683676.966821:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835520128 00000100:00100000:3.0:1789683676.966867:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 163 00000100:00100000:3.0:1789683676.966876:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+12:14900:x1876618835520128:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683676.967551:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+12:14900:x1876618835520128:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 Request processed in 673us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683676.967560:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 163 00000100:00100000:1.0:1789683676.977096:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683676.977478:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835520256 00000100:00100000:3.0:1789683676.977488:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835520256 00000100:00100000:3.0:1789683676.977547:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 164 00000100:00100000:3.0:1789683676.977558:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+12:14900:x1876618835520256:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683676.977713:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+12:14900:x1876618835520256:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 Request processed in 157us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683676.977721:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 164 00000100:00100000:0.0:1789683676.988042:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683676.988242:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835520384 00000100:00100000:3.0:1789683676.988255:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835520384 00000100:00100000:3.0:1789683676.988318:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 165 00000100:00100000:3.0:1789683676.988328:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+12:14900:x1876618835520384:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683676.988346:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683676.988365:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0f81677c00/0xcf8485587b88acef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc9e3 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683676.988411:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0f81677c00/0xcf8485587b88acef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9e3 expref: 13 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683676.988423:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0f81677c00/0xcf8485587b88acef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9e3 expref: 13 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683676.988433:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81677c00, rc 0) 00000100:00100000:3.0:1789683676.988502:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:14900:x1876618835520384:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 Request processed in 175us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683676.988509:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 165 00000100:00100000:2.0:1789683676.995929:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683676.996020:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835520512 00000100:00100000:3.0:1789683676.996031:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835520512 00000100:00100000:3.0:1789683676.996088:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 166 00000100:00100000:3.0:1789683676.996097:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:14900:x1876618835520512:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683676.996254:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:14900:x1876618835520512:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 Request processed in 157us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683676.996261:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 166 00000100:00100000:0.0:1789683677.001352:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683677.001630:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835520640 00000100:00100000:3.0:1789683677.001642:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835520640 00000100:00100000:3.0:1789683677.001706:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 167 00000100:00100000:3.0:1789683677.001716:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:14900:x1876618835520640:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683677.002094:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:14900:x1876618835520640:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 Request processed in 379us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683677.002102:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 167 00000100:00100000:0.0:1789683677.205962:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683677.206012:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683677.206049:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683677.206071:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683677.206092:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683677.206116:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683677.206136:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683677.206157:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683677.206197:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835520896 00000100:00100000:0.0:1789683677.206207:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835520896 00000100:00100000:0.0:1789683677.206260:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835521408 00000100:00100000:0.0:1789683677.206263:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835521408 00000100:00100000:0.0:1789683677.206276:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835520768 00000100:00100000:0.0:1789683677.206279:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835520768 00000100:00100000:0.0:1789683677.206290:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835521280 00000100:00100000:0.0:1789683677.206292:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835521280 00000100:00100000:0.0:1789683677.206308:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:0.0:1789683677.206317:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2402:x1876618835520896:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683677.206392:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2402:x1876618835520896:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 75us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683677.206400:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:0.0:1789683677.206417:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 62 00000100:00100000:0.0:1789683677.206424:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2402:x1876618835521408:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683677.206448:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2402:x1876618835521408:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683677.206454:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 62 00000100:00100000:0.0:1789683677.206465:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:0.0:1789683677.206471:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+6:2402:x1876618835520768:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683677.206494:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+6:2402:x1876618835520768:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 23us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683677.206500:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:0.0:1789683677.206511:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:0.0:1789683677.206517:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:2402:x1876618835521280:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683677.206540:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:2402:x1876618835521280:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 22us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683677.206552:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:0.0:1789683677.206571:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835521152 00000100:00100000:0.0:1789683677.206575:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835521152 00000100:00100000:0.0:1789683677.206593:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835521664 00000100:00100000:0.0:1789683677.206595:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835521664 00000100:00100000:0.0:1789683677.206606:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835521024 00000100:00100000:0.0:1789683677.206609:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835521024 00000100:00100000:0.0:1789683677.206619:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835521536 00000100:00100000:0.0:1789683677.206621:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835521536 00000100:00100000:0.0:1789683677.206634:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:0.0:1789683677.206641:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2402:x1876618835521152:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683677.206666:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2402:x1876618835521152:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 26us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683677.206672:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:0.0:1789683677.206684:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:0.0:1789683677.206690:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2402:x1876618835521664:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683677.206712:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2402:x1876618835521664:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 22us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683677.206718:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:0.0:1789683677.206729:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:0.0:1789683677.206735:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f86f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2402:x1876618835521024:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683677.206756:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f86f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2402:x1876618835521024:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 22us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683677.206762:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:0.0:1789683677.206919:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:0.0:1789683677.206934:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2402:x1876618835521536:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683677.206960:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2402:x1876618835521536:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 27us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683677.206967:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00080000:0.0:1789683677.207009:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683677.207014:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683677.207016:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683677.207018:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789683677.738079:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683678.752091:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683678.816204:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683678.817441:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683678.817466:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850288768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683678.817538:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683678.817591:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850288768 00000100:00100000:3.0:1789683678.817599:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850288768 00000100:00100000:3.0:1789683678.817656:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789683678.817667:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850288768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789683678.817696:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789683678.817743:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850288768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683678.817751:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789683678.817822:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850288768:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789683678.818068:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683678.819362:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850288640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683678.819424:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683678.819460:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683678.819470:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850289152:0@lo:400:kworker.0 00000100:00100000:0.0:1789683678.819496:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683678.819536:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850289152 00000100:00100000:0.0:1789683678.819543:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850289152 00000100:00100000:0.0:1789683678.819596:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789683678.819604:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850289152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683678.819653:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850289152:12345-0@lo:400:kworker.0 Request processed in 51us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683678.819660:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789683678.819699:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850289152:0@lo:400:kworker.0 00000100:00100000:0.0:1789683678.819741:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850288640 00000100:00100000:0.0:1789683678.819745:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850288640 00000100:00100000:0.0:1789683678.819768:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789683678.819775:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850288640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683678.819826:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789683678.819880:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850288640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683678.819888:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789683678.819909:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3649:1876618850288896:0@lo:400:kworker.0 00000100:00100000:0.0:1789683678.819938:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683678.819977:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683678.819984:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850289024:0@lo:400:kworker.0 00000100:00100000:0.0:1789683678.820009:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683678.820037:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850289024 00000100:00100000:0.0:1789683678.820042:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850289024 00000100:00100000:0.0:1789683678.820342:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789683678.820349:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850289024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683678.820392:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850289024:12345-0@lo:400:kworker.0 Request processed in 43us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683678.820398:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789683678.820428:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850289024:0@lo:400:kworker.0 00000100:00100000:0.0:1789683678.820456:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850288640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683678.820489:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850288896 00000100:00100000:0.0:1789683678.820493:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850288896 00000100:00100000:0.0:1789683678.820517:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789683678.820523:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3649:x1876618850288896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683678.820557:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3649:x1876618850288896:12345-0@lo:400:kworker.0 Request processed in 34us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683678.820563:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789683678.820600:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3649:1876618850288896:0@lo:400:kworker.0 00000100:00080000:0.0:1789683678.820635:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683678.820639:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683678.826107:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850289280:0@lo:400:kworker.0 00000100:00100000:0.0:1789683678.826187:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683678.826308:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850289280 00000100:00100000:1.0:1789683678.826315:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850289280 00000100:00100000:1.0:1789683678.826396:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789683678.826406:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb79b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850289280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683678.826745:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850289664:0@lo:400:kworker.0 00000100:00100000:2.0:1789683678.826819:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683678.826868:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850289408:0@lo:400:kworker.0 00000100:00100000:2.0:1789683678.826896:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683678.826916:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683678.826921:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850289536:0@lo:400:kworker.0 00000100:00100000:2.0:1789683678.826944:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683678.826990:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850289408 00000100:00100000:2.0:1789683678.826995:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850289408 00000100:00100000:2.0:1789683678.827027:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789683678.827034:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850289408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683678.827074:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850289408:12345-0@lo:400:kworker.0 Request processed in 40us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683678.827082:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789683678.827130:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850289408:0@lo:400:kworker.0 00000100:00100000:2.0:1789683678.827159:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850289536 00000100:00100000:2.0:1789683678.827162:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850289536 00000100:00100000:2.0:1789683678.827197:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789683678.827204:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850289536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683678.827249:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876618850289536:12345-0@lo:400:kworker.0 Request processed in 46us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683678.827256:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789683678.827294:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1876618850289536:0@lo:400:kworker.0 00000100:00100000:2.0:1789683678.827340:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850289664 00000100:00100000:2.0:1789683678.827345:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850289664 00000100:00100000:2.0:1789683678.827370:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789683678.827376:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850289664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683678.827411:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876618850289664:12345-0@lo:400:kworker.0 Request processed in 36us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683678.827417:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789683678.827445:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876618850289664:0@lo:400:kworker.0 00000100:00080000:2.0:1789683678.827466:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683678.836121:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb79b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876618850289280:12345-0@lo:400:kworker.0 Request processed in 9702us (9920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683678.836140:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789683678.836360:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876618850289280:0@lo:400:kworker.0 00000100:00100000:0.0:1789683678.836544:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850289792:0@lo:400:kworker.0 00000100:00100000:0.0:1789683678.836597:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683678.836680:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850289792 00000100:00100000:2.0:1789683678.836688:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850289792 00000100:00100000:1.0:1789683678.836724:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1876618850290176:0@lo:400:kworker.0 00000100:00100000:2.0:1789683678.836736:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789683678.836745:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850289792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683678.836751:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683678.836830:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850290176 00000100:00100000:1.0:1789683678.836835:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850290176 00000100:00100000:1.0:1789683678.836860:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789683678.836867:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876618850290176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683678.836901:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876618850290176:12345-0@lo:400:kworker.0 Request processed in 35us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683678.836906:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1789683678.836926:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789683678.836929:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789683678.836960:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0727800 x1876618850290176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683678.836971:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1876618850290176:0@lo:400:kworker.0 00000100:00100000:1.0:1789683678.837000:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850289920:0@lo:400:kworker.0 00000100:00100000:1.0:1789683678.837023:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683678.837040:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683678.837059:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fc0724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850290048:0@lo:400:kworker.0 00000100:00100000:1.0:1789683678.837092:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683678.837112:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850289920 00000100:00100000:1.0:1789683678.837116:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850289920 00000100:00100000:1.0:1789683678.837155:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850290048 00000100:00100000:1.0:1789683678.837158:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850290048 00000100:00100000:1.0:1789683678.837173:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789683678.837178:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850289920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683678.837211:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876618850289920:12345-0@lo:400:kworker.0 Request processed in 33us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683678.837218:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789683678.837230:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789683678.837235:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850290048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683678.837260:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876618850290048:12345-0@lo:400:kworker.0 Request processed in 25us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683678.837265:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1789683678.837279:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683678.837281:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789683678.837297:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1876618850290048:0@lo:400:kworker.0 00010000:00080000:1.0:1789683678.837307:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fc0726680 x1876618850289920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683678.837314:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1876618850289920:0@lo:400:kworker.0 00000100:00100000:2.0:1789683678.841990:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876618850289792:12345-0@lo:400:kworker.0 Request processed in 5203us (5349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683678.842008:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789683678.843237:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fc0726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1876618850289792:0@lo:400:kworker.0 00000100:00100000:3.0:1789683679.300090:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683679.302723:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835521792 00000100:00100000:1.0:1789683679.302739:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835521792 00000100:00100000:1.0:1789683679.302929:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:1.0:1789683679.302951:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+6:15566:x1876618835521792:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789683679.302973:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683679.302999:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db400/0xcf8485587b88acf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc9ea expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303111:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88acfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303127:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88acfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303140:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88acfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303154:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303161:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303167:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303251:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dba00/0xcf8485587b88ad0b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303260:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dba00/0xcf8485587b88ad0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303267:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dba00/0xcf8485587b88ad0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683679.303300:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789683679.303303:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789683679.303344:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dba00/0xcf8485587b88ad0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303366:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88acfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303374:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88acfd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303382:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88acfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303388:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837da800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683679.303392:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88acfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303400:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88acfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303413:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f82a2bd00) 00010000:00010000:1.0:1789683679.303417:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683679.303421:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88acfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303428:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88acfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303443:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303449:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303454:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303465:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837da600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683679.303468:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303474:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303482:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9f0fa0118f00) 00010000:00010000:1.0:1789683679.303484:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683679.303487:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303493:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303526:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db400/0xcf8485587b88acf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9ea expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303540:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dba00/0xcf8485587b88ad0b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9ea expref: 7 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.303546:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f0fa0118d00) 00010000:00010000:1.0:1789683679.303549:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683679.303551:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dba00, rc 0) 00000100:00100000:1.0:1789683679.303640:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+7:15566:x1876618835521792:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 702us (3561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683679.303648:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00080000:2.0:1789683679.309865:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683679.328809:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683679.328915:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835521920 00000100:00100000:1.0:1789683679.328957:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835521920 00000100:00100000:1.0:1789683679.329050:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:1.0:1789683679.329070:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1acf7a90-98f6-4b44-899e-7c61b5867591+7:15566:x1876618835521920:12345-192.168.201.50@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789683679.329167:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1acf7a90-98f6-4b44-899e-7c61b5867591+7:15566:x1876618835521920:12345-192.168.201.50@tcp:900:lhsmtool_posix.0 Request processed in 107us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683679.329174:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:0.0:1789683679.333322:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683679.333424:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835522176 00000100:00100000:1.0:1789683679.333434:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835522176 00000100:00100000:1.0:1789683679.333493:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:1.0:1789683679.333503:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+7:15566:x1876618835522176:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789683679.333526:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683679.333546:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db400/0xcf8485587b88ad12 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc9f1 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.333623:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad19 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.333637:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.333648:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.333705:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad20 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.333714:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.333721:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.333886:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da400/0xcf8485587b88ad27 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.333894:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da400/0xcf8485587b88ad27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.333900:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da400/0xcf8485587b88ad27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683679.333911:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789683679.335891:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.335908:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad19 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.335915:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad19 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.335922:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837da600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683679.335926:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad19 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.335933:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad19 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.335958:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f0fa0118d00) 00010000:00010000:1.0:1789683679.335961:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683679.335966:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad19 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.335990:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad19 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.336006:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.336013:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad20 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.336019:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.336023:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837da800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683679.336027:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.336300:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad20 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.336314:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f0fa0118f00) 00010000:00010000:1.0:1789683679.336316:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683679.336320:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad20 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.336326:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad20 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.342999:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db400/0xcf8485587b88ad12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9f1 expref: 10 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.343028:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da400/0xcf8485587b88ad27 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9f1 expref: 9 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.343324:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0fa0118100) 00010000:00010000:0.0:1789683679.343329:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683679.343333:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da400, rc 0) 00000100:00100000:0.0:1789683679.343519:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+9:15566:x1876618835522176:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 10016us (10204us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789683679.343528:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:2.0:1789683679.379565:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683679.379679:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835522304 00000100:00100000:1.0:1789683679.379689:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835522304 00000100:00100000:1.0:1789683679.379759:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:1.0:1789683679.379771:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+9:15566:x1876618835522304:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789683679.379922:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+9:15566:x1876618835522304:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 Request processed in 153us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683679.379930:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:2.0:1789683679.384686:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683679.384815:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835522432 00000100:00100000:0.0:1789683679.384824:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835522432 00000100:00100000:0.0:1789683679.384883:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 26 00000100:00100000:0.0:1789683679.384893:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+5:15566:x1876618835522432:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1789683679.385691:0:18733:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 695us 00000100:00080000:2.0:1789683679.386548:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789683679.412447:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683679.412954:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835522560 00000100:00100000:1.0:1789683679.412965:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835522560 00000100:00100000:1.0:1789683679.413027:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:1.0:1789683679.413048:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+9:15572:x1876618835522560:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789683679.413071:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683679.413091:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc9f8 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413161:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413177:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413189:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413204:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88ad43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413211:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88ad43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413217:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88ad43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413261:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413276:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413283:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413288:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837da600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683679.413295:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413303:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413316:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f82a2bd00) 00010000:00010000:1.0:1789683679.413319:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683679.413324:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413330:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413342:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88ad43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413348:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88ad43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413355:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88ad43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413359:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dae00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683679.413369:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88ad43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413375:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88ad43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413383:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f0fa0118f00) 00010000:00010000:1.0:1789683679.413386:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683679.413389:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88ad43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413396:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88ad43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413428:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad35 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9f8 expref: 10 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413438:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f82a2bd00) 00010000:00010000:1.0:1789683679.413440:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683679.413444:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9f8 expref: 10 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.413453:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da800, rc 0) 00000100:00100000:1.0:1789683679.416176:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+9:15572:x1876618835522560:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 3119us (3726us total) trans 0 rc 301/301 00000100:00100000:1.0:1789683679.416189:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:3.0:1789683679.421249:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+5:15566:x1876618835522432:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 Request processed in 36341us (36555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683679.421267:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 26 00000100:00100000:2.0:1789683679.436359:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683679.436475:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835522688 00000100:00100000:1.0:1789683679.436485:0:17209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835522688 00000100:00100000:1.0:1789683679.436541:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:1.0:1789683679.436552:0:17209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1acf7a90-98f6-4b44-899e-7c61b5867591+9:15572:x1876618835522688:12345-192.168.201.50@tcp:700:lfs.0 00000100:00100000:1.0:1789683679.436639:0:17209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1acf7a90-98f6-4b44-899e-7c61b5867591+9:15572:x1876618835522688:12345-192.168.201.50@tcp:700:lfs.0 Request processed in 88us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683679.436648:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:2.0:1789683679.443457:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683679.443554:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835522944 00000100:00100000:1.0:1789683679.443564:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835522944 00000100:00100000:1.0:1789683679.443629:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:1.0:1789683679.443640:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+9:15572:x1876618835522944:12345-192.168.201.50@tcp:36:lfs.0 00010000:00010000:1.0:1789683679.443704:0:17202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683679.443731:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88ac63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc965 expref: 9 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.443749:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f82a2bd00) 00010000:00010000:1.0:1789683679.443754:0:17202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789683679.443866:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad4a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.443882:0:17202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88aca2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9d5 expref: 5 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.443891:0:17202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad4a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.443925:0:17202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88aca2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9d5 expref: 5 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.443949:0:17202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88aca2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9d5 expref: 5 pid: 17200 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683679.443985:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83fc4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17202:1876618850290304:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789683679.444073:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f852ccd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683679.448046:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683679.448167:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83fc4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17202:1876618850290304:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789683679.448199:0:17202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad4a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683679.452704:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835523072 00000100:00100000:2.0:1789683679.452720:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835523072 00010000:00010000:2.0:1789683679.452822:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88aca2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9d5 expref: 6 pid: 17200 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683679.452865:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:2.0:1789683679.452875:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0726d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:2402:x1876618835523072:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683679.452893:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683679.452900:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88aca2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9d5 expref: 6 pid: 17200 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.452915:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88aca2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9d5 expref: 6 pid: 17200 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.452936:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88aca2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9d5 expref: 6 pid: 17200 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.452967:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f82a2bd00) 00010000:00010000:2.0:1789683679.452973:0:17187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad4a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.452981:0:17187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.452989:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad4a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.453017:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683679.453106:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0726d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2402:x1876618835523072:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 232us (5069us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683679.453114:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 15 00010000:00010000:2.0:1789683679.453264:0:17202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.453274:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.453298:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88ad51 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.453308:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88ad51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.453315:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88ad51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789683679.453949:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789683679.460742:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88ad58 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.460766:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88ad58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.460827:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88ad58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683679.460851:0:17202:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf4a085a reply state 000000001eca3e60 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88ad58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.460862:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88ad58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.460881:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0f853e3600) 00010000:00010000:2.0:1789683679.460884:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789683679.460888:0:17202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789683679.460894:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789683679.460902:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.460909:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad4a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.460917:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.460923:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837da800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683679.460927:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.460934:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad4a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.460952:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0f82a2bd00) 00010000:00010000:2.0:1789683679.460955:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683679.460958:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad4a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.460965:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad4a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683679.460983:0:17202:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf4a085a reply state 000000001eca3e60 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88ad51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.461004:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88ad51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.461010:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f0f853e3b00) 00010000:00010000:2.0:1789683679.461012:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789683679.461014:0:17202:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789683679.461117:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+10:15572:x1876618835522944:12345-192.168.201.50@tcp:36:lfs.0 Request processed in 17475us (17666us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789683679.461128:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 28 00000040:00080000:1.0:1789683679.519486:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789683679.634151:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683679.634320:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835523200 00000100:00100000:1.0:1789683679.634331:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835523200 00000100:00100000:1.0:1789683679.634406:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:1.0:1789683679.634418:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+10:15580:x1876618835523200:12345-192.168.201.50@tcp:101:lctl.0 00010000:00010000:1.0:1789683679.634445:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683679.634980:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88ad5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bc9ff expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.635050:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.635065:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.635078:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683679.635124:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789683679.635128:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789683679.635184:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.635210:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88ad5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9ff expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.635231:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da600/0xcf8485587b88ad66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bc9ff expref: 11 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.635239:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fa0118f00) 00010000:00010000:1.0:1789683679.635242:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683679.635245:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837da600, rc 0) 00000100:00100000:1.0:1789683679.635317:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+11:15580:x1876618835523200:12345-192.168.201.50@tcp:101:lctl.0 Request processed in 901us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683679.635324:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:3.0:1789683679.690265:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683679.690565:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835523328 00000100:00100000:0.0:1789683679.690575:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835523328 00000100:00100000:0.0:1789683679.690641:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:0.0:1789683679.690652:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:15581:x1876618835523328:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789683679.690675:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683679.690707:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c400/0xcf8485587b88ad6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca06 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.691127:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88ad74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.691146:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88ad74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.691161:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88ad74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683679.691215:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789683679.691220:0:17200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683679.691242:0:17200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88ad74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.691268:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c400/0xcf8485587b88ad6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca06 expref: 7 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.691288:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454da00/0xcf8485587b88ad74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca06 expref: 6 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.691318:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fa0118f00) 00010000:00010000:0.0:1789683679.691321:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683679.691325:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454da00, rc 0) 00000100:00100000:0.0:1789683679.691393:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:15581:x1876618835523328:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 743us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683679.691402:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:2.0:1789683679.698387:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683679.698676:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835523456 00000100:00100000:1.0:1789683679.698697:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835523456 00000100:00100000:1.0:1789683679.698760:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:1.0:1789683679.698771:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:15581:x1876618835523456:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789683679.698831:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683679.698851:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88ad7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca0d expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.698919:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.698944:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.698956:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.698984:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ad89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.698992:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ad89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.698999:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ad89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699075:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db400/0xcf8485587b88ad90 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699083:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db400/0xcf8485587b88ad90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699089:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db400/0xcf8485587b88ad90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683679.699130:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789683679.699134:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789683679.699157:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db400/0xcf8485587b88ad90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699169:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699176:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad82 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699184:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699199:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837da800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683679.699204:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699211:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad82 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699222:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fa0118f00) 00010000:00010000:1.0:1789683679.699225:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683679.699231:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699237:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88ad82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699250:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ad89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699255:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ad89 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699260:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ad89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699265:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dbc00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683679.699267:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ad89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699274:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ad89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699292:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f0f853e3b00) 00010000:00010000:1.0:1789683679.699295:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683679.699298:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ad89 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699304:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ad89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699328:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88ad7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca0d expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699341:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db400/0xcf8485587b88ad90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca0d expref: 7 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.699348:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0f853e3600) 00010000:00010000:1.0:1789683679.699351:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683679.699353:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837db400, rc 0) 00000100:00100000:1.0:1789683679.699427:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+7:15581:x1876618835523456:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 658us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683679.699435:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:3.0:1789683679.707346:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683679.707447:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835523584 00000100:00100000:1.0:1789683679.707457:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835523584 00000100:00100000:1.0:1789683679.707538:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:1.0:1789683679.707549:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:15581:x1876618835523584:12345-192.168.201.50@tcp:900:lfs.0 00000100:00100000:1.0:1789683679.707650:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:15581:x1876618835523584:12345-192.168.201.50@tcp:900:lfs.0 Request processed in 102us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683679.707658:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00080000:2.0:1789683679.710632:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789683679.717258:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683679.717431:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835523840 00000100:00100000:1.0:1789683679.717442:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835523840 00000100:00100000:1.0:1789683679.717517:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 32 00000100:00100000:1.0:1789683679.717529:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+7:15581:x1876618835523840:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789683679.717559:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683679.717580:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88ad97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca14 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683679.717707:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789683679.717863:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88ad97 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca14 expref: 9 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.717876:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fa0118f00) 00010000:00010000:1.0:1789683679.717879:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789683679.717885:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88ad97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca14 expref: 9 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.717899:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dae00, rc 0) 00000100:00100000:1.0:1789683679.717973:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+8:15581:x1876618835523840:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 446us (725us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789683679.717981:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 32 00000100:00100000:0.0:1789683679.722857:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683679.723132:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835524096 00000100:00100000:1.0:1789683679.723142:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835524096 00000100:00100000:1.0:1789683679.723194:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:1.0:1789683679.723203:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb799ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+8:15581:x1876618835524096:12345-192.168.201.50@tcp:36:lfs.0 00010000:00010000:1.0:1789683679.723271:0:17201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683679.723297:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837db400/0xcf8485587b88ad90 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca0d expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.723344:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0f853e3600) 00010000:00010000:1.0:1789683679.723349:0:17201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789683679.723370:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ada5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.723382:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ada5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.723391:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ada5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789683679.723600:0:17201:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df098e8f reply state 000000007dfa1ed4 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ada5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.723613:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ada5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.723619:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0f853e3600) 00010000:00010000:1.0:1789683679.723622:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1789683679.723625:0:17201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789683679.723633:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789683679.723716:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb799ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+9:15581:x1876618835524096:12345-192.168.201.50@tcp:36:lfs.0 Request processed in 512us (868us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789683679.723723:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:3.0:1789683679.728447:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683679.736092:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835524352 00000100:00100000:2.0:1789683679.736109:0:17203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835524352 00000100:00100000:2.0:1789683679.736187:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:2.0:1789683679.736199:0:17203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+9:15581:x1876618835524352:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:2.0:1789683679.738010:0:17203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+10:15581:x1876618835524352:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 1806us (9565us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789683679.738022:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:2.0:1789683679.761054:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683679.761145:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835524608 00000100:00100000:1.0:1789683679.761157:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835524608 00000100:00100000:1.0:1789683679.761210:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:1.0:1789683679.761234:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+10:15581:x1876618835524608:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789683679.761260:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683679.761295:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88adac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca1b expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761371:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88adb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761386:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88adb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761410:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88adb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761422:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88adba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761429:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88adba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761436:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88adba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683679.761542:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789683679.761614:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88adb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761622:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88adb3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761629:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88adb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761635:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837da800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683679.761639:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88adb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761656:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88adb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761670:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fa0118f00) 00010000:00010000:1.0:1789683679.761673:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683679.761678:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88adb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761684:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837da800/0xcf8485587b88adb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761698:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88adba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761703:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88adba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761709:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88adba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761714:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683679.761717:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88adba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761723:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88adba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761730:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f0f853e3b00) 00010000:00010000:1.0:1789683679.761733:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683679.761737:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88adba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761752:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88adba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761835:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88adac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca1b expref: 12 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761846:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fa0118f00) 00010000:00010000:1.0:1789683679.761848:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789683679.761851:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dae00/0xcf8485587b88adac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca1b expref: 12 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.761862:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0e837dae00, rc 0) 00000100:00100000:1.0:1789683679.761925:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+11:15581:x1876618835524608:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 705us (879us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789683679.761931:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:1.0:1789683679.766411:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683679.766480:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835524736 00000100:00100000:2.0:1789683679.766490:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835524736 00000100:00100000:2.0:1789683679.766553:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00100000:2.0:1789683679.766562:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+11:15581:x1876618835524736:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683679.766586:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683679.766608:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b88adc8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca22 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.766724:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88adcf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.766737:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88adcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.766748:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88adcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683679.766769:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789683679.766773:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683679.767109:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88adcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.767139:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b88adc8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca22 expref: 13 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.767157:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88adcf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca22 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683679.767165:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0f853e3600) 00010000:00010000:2.0:1789683679.767167:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683679.767171:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6177000, rc 0) 00000100:00100000:2.0:1789683679.767359:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+12:15581:x1876618835524736:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 796us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683679.767366:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 35 00010000:00010000:3.0:1789683679.775019:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683679.783651:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683679.783829:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835524864 00000100:00100000:0.0:1789683679.783840:0:17204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835524864 00000100:00100000:0.0:1789683679.783899:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:0.0:1789683679.783909:0:17204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+12:15581:x1876618835524864:12345-192.168.201.50@tcp:37:lfs.0 00000100:00100000:0.0:1789683679.792027:0:17204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+12:15581:x1876618835524864:12345-192.168.201.50@tcp:37:lfs.0 Request processed in 8108us (8375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683679.792042:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:1.0:1789683679.801546:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683679.801777:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835525120 00000100:00100000:2.0:1789683679.801826:0:17203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835525120 00000100:00100000:2.0:1789683679.801883:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:2.0:1789683679.801893:0:17203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f897a8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+12:15581:x1876618835525120:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:2.0:1789683679.802113:0:17203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f897a8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+13:15581:x1876618835525120:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 221us (575us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789683679.802120:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:3.0:1789683679.900346:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683679.900578:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835525248 00000100:00100000:1.0:1789683679.900588:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835525248 00000100:00100000:1.0:1789683679.900652:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 36 00000100:00100000:1.0:1789683679.900663:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+11:15587:x1876618835525248:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:1.0:1789683679.900686:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683679.900708:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9200/0xcf8485587b88add6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca29 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.901106:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88addd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.901139:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88addd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.901151:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88addd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.901164:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88ade4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.901171:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88ade4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.901178:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88ade4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.901255:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88adeb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.901265:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88adeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.901272:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88adeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683679.901306:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789683679.901311:0:17202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789683679.901351:0:17202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88adeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.901363:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88addd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.901378:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88addd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.901385:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88addd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.901391:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683679.901395:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88addd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.901403:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88addd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.901415:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fa0118f00) 00010000:00010000:1.0:1789683679.901417:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683679.901423:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88addd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.901429:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88addd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.901441:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88ade4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.904595:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88ade4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.904610:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88ade4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.904617:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683679.904642:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88ade4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.904653:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88ade4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.904670:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f0f853e3b00) 00010000:00010000:1.0:1789683679.904673:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683679.904678:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88ade4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.904686:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88ade4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.904746:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9200/0xcf8485587b88add6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca29 expref: 13 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.904763:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9600/0xcf8485587b88adeb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca29 expref: 12 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683679.904771:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0f853e3600) 00010000:00010000:1.0:1789683679.904773:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789683679.904776:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f9600, rc 0) 00000100:00100000:1.0:1789683679.904943:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+12:15587:x1876618835525248:12345-192.168.201.50@tcp:101:bash.0 Request processed in 4272us (4597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683679.904952:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 36 00000100:00100000:3.0:1789683679.909013:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683679.911035:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835525376 00000100:00100000:1.0:1789683679.911050:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835525376 00000100:00100000:1.0:1789683679.911120:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:1.0:1789683679.911130:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1acf7a90-98f6-4b44-899e-7c61b5867591+5:15587:x1876618835525376:12345-192.168.201.50@tcp:900:bash.0 00000100:00100000:1.0:1789683679.911251:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1acf7a90-98f6-4b44-899e-7c61b5867591+5:15587:x1876618835525376:12345-192.168.201.50@tcp:900:bash.0 Request processed in 123us (2247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683679.911259:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:2.0:1789683679.916498:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683679.916615:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835525632 00000100:00100000:0.0:1789683679.916626:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835525632 00000100:00100000:0.0:1789683679.916696:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 37 00000100:00100000:0.0:1789683679.916706:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+12:15587:x1876618835525632:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789683679.916728:0:18733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683679.916752:0:18733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b88adf2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca30 expref: -99 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.916899:0:18733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88adf9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.916915:0:18733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88adcf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca22 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.916950:0:18733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88adf9 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.916983:0:18733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88adcf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca22 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.916997:0:18733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88adcf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca22 expref: 12 pid: 17201 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683679.917010:0:18733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18733:1876618850290432:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789683679.917090:0:18733:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f86544300 going to sleep for 11 seconds 00000100:00100000:0.0:1789683679.920974:0:18733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18733:1876618850290432:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789683679.921008:0:18733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88adf9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683679.923311:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683679.924079:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835525760 00000100:00100000:0.0:1789683679.924091:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835525760 00010000:00010000:0.0:1789683679.924139:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88adcf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca22 expref: 13 pid: 17201 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683679.924184:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:0.0:1789683679.924193:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+13:2402:x1876618835525760:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683679.924208:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683679.924216:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88adcf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca22 expref: 13 pid: 17201 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.924260:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88adcf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca22 expref: 13 pid: 17201 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.924281:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88adcf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca22 expref: 13 pid: 17201 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.924297:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0f853e3600) 00010000:00010000:0.0:1789683679.924303:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88adf9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.924312:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88adf9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.924319:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88adf9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.924353:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683679.924429:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+12:2402:x1876618835525760:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 236us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683679.924436:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 16 00010000:00010000:3.0:1789683679.924624:0:18733:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88adf9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683679.924640:0:18733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88adf9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683679.924666:0:18733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677800/0xcf8485587b88ae00 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683679.924686:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677800/0xcf8485587b88ae00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683679.924695:0:18733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677800/0xcf8485587b88ae00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683679.925226:0:18733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88ae07 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683679.925237:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88ae07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683679.925244:0:18733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88ae07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683679.925256:0:18733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789683679.925281:0:18733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88adf9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683679.925288:0:18733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88adf9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683679.925295:0:18733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88adf9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683679.925301:0:18733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454ce00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683679.925312:0:18733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88adf9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683679.925320:0:18733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88adf9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683679.925330:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0f853e3600) 00010000:00010000:3.0:1789683679.925334:0:18733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683679.925338:0:18733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88adf9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683679.925345:0:18733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88adf9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683679.925356:0:18733:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076b103cc reply state 00000000a85fca35 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677800/0xcf8485587b88ae00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683679.925366:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677800/0xcf8485587b88ae00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683679.925372:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9f0e81f6cb00) 00010000:00010000:3.0:1789683679.925374:0:18733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789683679.925376:0:18733:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789683679.925411:0:18733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b88adf2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca30 expref: 15 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683679.925426:0:18733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88ae07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca30 expref: 14 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683679.925432:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:3.0:1789683679.925435:0:18733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789683679.925443:0:18733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81676400, rc 0) 00000100:00100000:3.0:1789683679.925515:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+15:15587:x1876618835525632:12345-192.168.201.50@tcp:101:bash.0 Request processed in 8801us (9018us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789683679.925523:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 37 00000100:00100000:2.0:1789683679.962683:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683679.962825:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835525888 00000100:00100000:0.0:1789683679.962836:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835525888 00000100:00100000:0.0:1789683679.962899:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 38 00000100:00100000:0.0:1789683679.962910:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+15:15587:x1876618835525888:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789683679.962967:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683679.962988:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b88ae15 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca37 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.963072:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88ae1c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.963087:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88ae1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.963100:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88ae1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683679.963152:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789683679.963157:0:17200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789683679.963180:0:17200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88ae1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.963190:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88ae1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.963213:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ca00/0xcf8485587b88ae15 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca37 expref: 17 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.963246:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88ae1c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca37 expref: 16 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683679.963255:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:0.0:1789683679.963258:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683679.963262:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454ce00, rc 0) 00000100:00100000:0.0:1789683679.963328:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+16:15587:x1876618835525888:12345-192.168.201.50@tcp:101:bash.0 Request processed in 420us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683679.963336:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 38 00000100:00100000:0.0:1789683679.966894:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683679.966997:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835526144 00000100:00100000:2.0:1789683679.967007:0:17203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835526144 00000100:00100000:2.0:1789683679.967068:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:2.0:1789683679.967080:0:17203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+16:15587:x1876618835526144:12345-192.168.201.50@tcp:35:bash.0 00000100:00100000:2.0:1789683679.967383:0:17203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+17:15587:x1876618835526144:12345-192.168.201.50@tcp:35:bash.0 Request processed in 305us (498us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789683679.967401:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:3.0:1789683680.158304:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683680.158422:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835526400 00000100:00100000:2.0:1789683680.158433:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835526400 00000100:00100000:2.0:1789683680.158518:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 39 00000100:00100000:2.0:1789683680.158529:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+17:15597:x1876618835526400:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683680.158556:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683680.158581:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88ae23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca3e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683680.158682:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789683680.158831:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88ae23 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca3e expref: 19 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683680.158867:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fa0118f00) 00010000:00010000:2.0:1789683680.158871:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789683680.158877:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88ae23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca3e expref: 19 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683680.158891:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6177000, rc 0) 00000100:00100000:2.0:1789683680.159140:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+18:15597:x1876618835526400:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 612us (846us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789683680.159148:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 39 00000100:00100000:1.0:1789683680.172127:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683680.172235:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835526656 00000100:00100000:2.0:1789683680.172247:0:17203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835526656 00000100:00100000:2.0:1789683680.172306:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:2.0:1789683680.172315:0:17203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+18:15597:x1876618835526656:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:2.0:1789683680.172554:0:17203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+19:15597:x1876618835526656:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 239us (438us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789683680.172562:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:0.0:1789683680.280547:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683680.280710:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835526912 00000100:00100000:3.0:1789683680.280720:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835526912 00000100:00100000:3.0:1789683680.280825:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 40 00000100:00100000:3.0:1789683680.280836:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+19:15600:x1876618835526912:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789683680.280862:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683680.280883:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88ae31 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca45 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.281021:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677000/0xcf8485587b88ae38 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.281036:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677000/0xcf8485587b88ae38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.281048:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677000/0xcf8485587b88ae38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683680.281061:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789683680.281160:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88ae31 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca45 expref: 22 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.281177:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677000/0xcf8485587b88ae38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca45 expref: 21 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.281204:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:3.0:1789683680.281207:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683680.281221:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81677000, rc 0) 00000100:00100000:3.0:1789683680.281286:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+21:15600:x1876618835526912:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 453us (750us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789683680.281293:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 40 00000040:00080000:1.0:1789683680.287640:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789683680.288669:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683680.289325:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835527040 00000100:00100000:0.0:1789683680.289336:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835527040 00000100:00100000:0.0:1789683680.289415:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:0.0:1789683680.289425:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+21:2405:x1876618835527040:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683680.289441:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683680.289472:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677000/0xcf8485587b88ae38 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca45 expref: 21 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683680.289493:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:0.0:1789683680.289498:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683680.289564:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+20:2405:x1876618835527040:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 141us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683680.289572:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:2.0:1789683680.302676:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683680.302761:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835527168 00000100:00100000:3.0:1789683680.302773:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835527168 00000100:00100000:3.0:1789683680.302874:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00100000:3.0:1789683680.302884:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+20:15600:x1876618835527168:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:3.0:1789683680.302966:0:18733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88ae46 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.302983:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88ae46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.302994:0:18733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88ae46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.303032:0:18733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88ae46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.303040:0:18733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88ae46 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.303049:0:18733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88ae46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.303078:0:18733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683680.303083:0:18733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88ae46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.303091:0:18733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88ae46 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.303104:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:3.0:1789683680.303108:0:18733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683680.303113:0:18733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88ae46 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.303121:0:18733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88ae46 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683680.303442:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+20:15600:x1876618835527168:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 323us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683680.303462:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00100000:1.0:1789683680.309707:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683680.309827:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835527424 00000100:00100000:2.0:1789683680.309837:0:17203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835527424 00000100:00100000:2.0:1789683680.309898:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:2.0:1789683680.309909:0:17203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+20:15600:x1876618835527424:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:2.0:1789683680.310140:0:17203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+21:15600:x1876618835527424:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 233us (442us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789683680.310148:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:1.0:1789683680.651148:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683680.655320:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835527680 00000100:00100000:3.0:1789683680.655335:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835527680 00000100:00100000:3.0:1789683680.655865:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 42 00000100:00100000:3.0:1789683680.655878:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+21:15631:x1876618835527680:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:3.0:1789683680.655906:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683680.655941:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88ae4d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca4c expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.656051:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676800/0xcf8485587b88ae54 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.656086:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676800/0xcf8485587b88ae54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.656099:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676800/0xcf8485587b88ae54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683680.656112:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789683680.656255:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88ae4d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca4c expref: 24 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.656274:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676800/0xcf8485587b88ae54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca4c expref: 23 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.656283:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:3.0:1789683680.656286:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683680.656290:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81676800, rc 0) 00000100:00100000:3.0:1789683680.656354:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+23:15631:x1876618835527680:12345-192.168.201.50@tcp:101:cat.0 Request processed in 479us (5214us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1789683680.656362:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 42 00000100:00100000:1.0:1789683680.661991:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683680.662129:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835527808 00000100:00100000:3.0:1789683680.662139:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835527808 00000100:00100000:3.0:1789683680.662215:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:3.0:1789683680.662225:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+23:2405:x1876618835527808:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683680.662240:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683680.662267:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676800/0xcf8485587b88ae54 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca4c expref: 23 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.662303:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:3.0:1789683680.662309:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683680.662374:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+22:2405:x1876618835527808:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 150us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683680.663291:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:0.0:1789683680.667765:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683680.674897:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835528064 00000100:00100000:2.0:1789683680.674914:0:17203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835528064 00000100:00100000:2.0:1789683680.674997:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:2.0:1789683680.675007:0:17203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f88c76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+22:15631:x1876618835528064:12345-192.168.201.50@tcp:35:cat.0 00000100:00100000:2.0:1789683680.675326:0:17203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f88c76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+23:15631:x1876618835528064:12345-192.168.201.50@tcp:35:cat.0 Request processed in 319us (7570us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789683680.675334:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:1.0:1789683680.778341:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683680.778444:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835528320 00000100:00100000:2.0:1789683680.778467:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835528320 00000100:00100000:2.0:1789683680.778554:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:2.0:1789683680.778566:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+23:15637:x1876618835528320:12345-192.168.201.50@tcp:101:dd.0 00010000:00010000:2.0:1789683680.778596:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683680.778622:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b88ae62 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca53 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683680.778762:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88ae69 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683680.778779:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88ae69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683680.778841:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88ae69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683680.778853:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789683680.779015:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177400/0xcf8485587b88ae62 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca53 expref: 26 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683680.779036:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88ae69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca53 expref: 25 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683680.779064:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:2.0:1789683680.779068:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683680.779072:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb6177000, rc 0) 00000100:00100000:2.0:1789683680.779138:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+25:15637:x1876618835528320:12345-192.168.201.50@tcp:101:dd.0 Request processed in 574us (807us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789683680.779145:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:1.0:1789683680.786066:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683680.786118:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683680.786194:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835528448 00000100:00100000:2.0:1789683680.786213:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835528448 00000100:00100000:2.0:1789683680.786276:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 44 00000100:00100000:2.0:1789683680.786287:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+25:15637:x1876618835528448:12345-192.168.201.50@tcp:101:dd.0 00010000:00010000:2.0:1789683680.786317:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683680.786340:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31e00/0xcf8485587b88ae77 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca5a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683680.786376:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31000/0xcf8485587b88ae7e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683680.786402:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31000/0xcf8485587b88ae7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683680.786415:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31000/0xcf8485587b88ae7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683680.786635:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31e00/0xcf8485587b88ae77 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca5a expref: 27 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683680.786654:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31000/0xcf8485587b88ae7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca5a expref: 26 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683680.786826:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:2.0:1789683680.786829:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789683680.786833:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31000, rc 0) 00000100:00100000:2.0:1789683680.786894:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+26:15637:x1876618835528448:12345-192.168.201.50@tcp:101:dd.0 Request processed in 608us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683680.786901:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 44 00000100:00100000:3.0:1789683680.788955:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835528576 00000100:00100000:3.0:1789683680.788969:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835528576 00000100:00100000:3.0:1789683680.789043:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:3.0:1789683680.789055:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+26:2405:x1876618835528576:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683680.789070:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683680.789093:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6177000/0xcf8485587b88ae69 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca53 expref: 26 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683680.789111:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:3.0:1789683680.789115:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683680.789176:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+25:2405:x1876618835528576:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 124us (3058us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683680.789183:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:1.0:1789683680.796141:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683680.796241:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835528832 00000100:00100000:2.0:1789683680.796254:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835528832 00000100:00100000:2.0:1789683680.796320:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 45 00000100:00100000:2.0:1789683680.796332:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+25:15637:x1876618835528832:12345-192.168.201.50@tcp:36:dd.0 00010000:00010000:2.0:1789683680.796405:0:17201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683680.796434:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454ce00/0xcf8485587b88ae1c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca37 expref: 25 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683680.796454:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:2.0:1789683680.796459:0:17201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683680.796701:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31e00/0xcf8485587b88ae85 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683680.796719:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31e00/0xcf8485587b88ae85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683680.796730:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31e00/0xcf8485587b88ae85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789683680.796776:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789683680.796840:0:17201:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4b3f5be reply state 00000000acf7cf3b transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31e00/0xcf8485587b88ae85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683680.796860:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31e00/0xcf8485587b88ae85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683680.796867:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:2.0:1789683680.796870:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789683680.796873:0:17201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683680.796982:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+27:15637:x1876618835528832:12345-192.168.201.50@tcp:36:dd.0 Request processed in 652us (850us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789683680.796990:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 45 00000020:00080000:2.0:1789683680.796996:0:17201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789683680.799002:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683680.863217:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850290560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683680.863292:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683680.863399:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850290560 00000100:00100000:2.0:1789683680.863408:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850290560 00000100:00100000:2.0:1789683680.863482:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789683680.863494:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850290560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789683680.863527:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789683680.863583:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850290560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683680.863589:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789683680.863652:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683680.863697:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850290560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683680.865942:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683680.865969:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850290688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683680.866053:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683680.867645:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850290688 00000100:00100000:2.0:1789683680.867667:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850290688 00000100:00100000:2.0:1789683680.867736:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789683680.867746:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850290688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789683680.867809:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789683680.867879:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850290688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683680.867886:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789683680.868244:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850290688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789683680.870923:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850290816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789683680.871003:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683680.871089:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850290816 00000100:00100000:2.0:1789683680.871098:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850290816 00000100:00100000:2.0:1789683680.871160:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789683680.871169:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850290816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789683680.871337:0:17941:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789683680.877909:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850290816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6729us (6894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683680.877958:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789683680.880290:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850290816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683680.940971:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683680.941079:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835529088 00000100:00100000:2.0:1789683680.941090:0:17203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835529088 00000100:00100000:2.0:1789683680.941410:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:2.0:1789683680.941423:0:17203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+27:15637:x1876618835529088:12345-192.168.201.50@tcp:35:dd.0 00000100:00100000:2.0:1789683680.941689:0:17203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+28:15637:x1876618835529088:12345-192.168.201.50@tcp:35:dd.0 Request processed in 268us (729us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1789683680.941697:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:1.0:1789683681.291996:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683681.292439:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835529216 00000100:00100000:2.0:1789683681.292451:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835529216 00000100:00100000:2.0:1789683681.292543:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 46 00000100:00100000:2.0:1789683681.292555:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+28:15651:x1876618835529216:12345-192.168.201.50@tcp:101:stat.0 00010000:00010000:2.0:1789683681.292580:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683681.292601:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88ae8c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca61 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789683681.292636:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789683681.292669:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b88ae93 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.292683:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b88ae93 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.292711:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b88ae93 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.292724:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88ae9a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.292732:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88ae9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.292739:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88ae9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.292872:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88aea1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.292881:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88aea1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.292890:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88aea1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683681.292936:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789683681.292940:0:17202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683681.292973:0:17202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88aea1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.292983:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88aea1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.292992:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b88ae93 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.293006:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b88ae93 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.293012:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b88ae93 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.293017:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683681.293022:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b88ae93 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.293029:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b88ae93 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.293039:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0f853e3600) 00010000:00010000:2.0:1789683681.293042:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683681.293046:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b88ae93 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.293052:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b88ae93 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.293063:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88ae9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.293068:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88ae9a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.293073:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88ae9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.293078:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30000 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683681.293084:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88ae9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.293090:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88ae9a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.293095:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9f0e81f6cb00) 00010000:00010000:2.0:1789683681.293097:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683681.293100:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88ae9a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.293104:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88ae9a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.293126:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88ae8c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca61 expref: 30 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.293138:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88aea1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca61 expref: 29 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.293144:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:2.0:1789683681.293146:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683681.293148:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30600, rc 0) 00000100:00100000:2.0:1789683681.293295:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+29:15651:x1876618835529216:12345-192.168.201.50@tcp:101:stat.0 Request processed in 742us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683681.293377:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 46 00000100:00100000:1.0:1789683681.403894:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683681.403961:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835529472 00000100:00100000:2.0:1789683681.403970:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835529472 00000100:00100000:2.0:1789683681.404042:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:2.0:1789683681.404052:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+29:15658:x1876618835529472:12345-192.168.201.50@tcp:36:truncate.0 00010000:00010000:2.0:1789683681.404402:0:17201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683681.404431:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88aea1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca61 expref: 29 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.404451:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:2.0:1789683681.404456:0:17201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683681.404661:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88aea8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.404676:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88aea8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.404686:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88aea8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789683681.404737:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1789683681.404759:0:17201:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2127bb1 reply state 00000000fcc54530 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88aea8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.404771:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88aea8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.404777:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:2.0:1789683681.404779:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789683681.404834:0:17201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683681.404959:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+31:15658:x1876618835529472:12345-192.168.201.50@tcp:36:truncate.0 Request processed in 908us (1073us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1789683681.404967:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 47 00000020:00080000:2.0:1789683681.404973:0:17201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1789683681.567637:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789683681.593491:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683681.593556:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835529600 00000100:00100000:1.0:1789683681.593567:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835529600 00000100:00100000:1.0:1789683681.593631:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:1.0:1789683681.593641:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+31:15672:x1876618835529600:12345-192.168.201.50@tcp:101:stat.0 00010000:00010000:1.0:1789683681.593665:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683681.593693:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9200/0xcf8485587b88aeaf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca68 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.593770:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88aeb6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.593806:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88aeb6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.593818:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88aeb6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.593832:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88aebd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.593839:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88aebd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.593846:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88aebd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.593933:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88aec4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.593942:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88aec4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.593948:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88aec4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683681.593993:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1789683681.593998:0:17202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789683681.594020:0:17202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88aec4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.594038:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88aec4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.594046:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88aeb6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.594052:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88aeb6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.594058:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88aeb6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.594064:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683681.594068:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88aeb6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.594077:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88aeb6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.594145:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0f853e3600) 00010000:00010000:1.0:1789683681.594148:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683681.594153:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88aeb6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.594159:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8800/0xcf8485587b88aeb6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.594172:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88aebd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.594178:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88aebd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.594191:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88aebd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.594196:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683681.594199:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88aebd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.594205:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88aebd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.594212:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9f0e81f6cb00) 00010000:00010000:1.0:1789683681.594215:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683681.594218:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88aebd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.594223:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f8600/0xcf8485587b88aebd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.594249:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9200/0xcf8485587b88aeaf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca68 expref: 33 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.594262:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88aec4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca68 expref: 32 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.594268:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:1.0:1789683681.594270:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683681.594273:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f9c00, rc 0) 00000100:00100000:1.0:1789683681.594336:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+32:15672:x1876618835529600:12345-192.168.201.50@tcp:101:stat.0 Request processed in 697us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683681.594352:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:1.0:1789683681.711512:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683681.711640:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835529856 00000100:00100000:2.0:1789683681.711664:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835529856 00000100:00100000:2.0:1789683681.711731:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 49 00000100:00100000:2.0:1789683681.711742:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+32:15682:x1876618835529856:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789683681.711763:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683681.711841:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88aecb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca6f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683681.711951:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789683681.712052:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88aecb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca6f expref: 34 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.712066:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fa0118f00) 00010000:00010000:2.0:1789683681.712069:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789683681.712075:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88aecb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca6f expref: 34 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.712088:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30600, rc 0) 00000100:00100000:2.0:1789683681.712146:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+33:15682:x1876618835529856:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 406us (647us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1789683681.712153:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 49 00000100:00100000:0.0:1789683681.730115:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683681.730223:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835530112 00000100:00100000:3.0:1789683681.730234:0:17204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835530112 00000100:00100000:3.0:1789683681.730363:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:3.0:1789683681.730385:0:17204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0f897a8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+33:15682:x1876618835530112:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789683681.730624:0:17204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0f897a8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+34:15682:x1876618835530112:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 242us (518us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1789683681.730650:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 10 00010000:00010000:3.0:1789683681.822994:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683681.873892:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683681.874347:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835530368 00000100:00100000:2.0:1789683681.874369:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835530368 00000100:00100000:2.0:1789683681.874438:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:2.0:1789683681.874448:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+34:15688:x1876618835530368:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683681.874472:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683681.874493:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88aed9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca76 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.874644:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88aee0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.874660:0:17202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88ae07 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca30 expref: 35 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.874668:0:17202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88aec4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca68 expref: 35 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.874676:0:17202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88aee0 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.874709:0:17202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88aec4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca68 expref: 35 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.874723:0:17202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88aec4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca68 expref: 35 pid: 17202 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683681.874737:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17202:1876618850290944:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683681.874872:0:17202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88ae07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca30 expref: 35 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.874882:0:17202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88ae07 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca30 expref: 35 pid: 18733 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683681.874891:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17202:1876618850291072:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683681.874935:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb85c9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683681.885613:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17202:1876618850290944:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683681.885630:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17202:1876618850291072:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683681.885658:0:17202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88aee0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683681.887302:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683681.887324:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850291200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683681.887421:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683681.887572:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850291200 00000100:00100000:2.0:1789683681.887582:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850291200 00000100:00100000:2.0:1789683681.887657:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789683681.887667:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850291200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789683681.887689:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789683681.887733:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876618850291200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683681.887741:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789683681.888033:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1876618850291200:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789683681.888262:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683681.889332:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683681.889379:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683681.889620:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835530496 00000100:00100000:0.0:1789683681.889630:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835530496 00010000:00010000:0.0:1789683681.889671:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88aec4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca68 expref: 36 pid: 17202 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683681.889709:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835530624 00000100:00100000:0.0:1789683681.889712:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835530624 00010000:00010000:0.0:1789683681.889725:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88ae07 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca30 expref: 37 pid: 18733 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683681.889740:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:0.0:1789683681.889747:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7949450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+37:2403:x1876618835530496:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683681.889761:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683681.889768:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88aec4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca68 expref: 37 pid: 17202 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683681.889780:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88aec4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca68 expref: 37 pid: 17202 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683681.889852:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88aec4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca68 expref: 37 pid: 17202 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683681.889868:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:0.0:1789683681.889874:0:17185:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88aee0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683681.889912:0:17185:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88aee0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683681.889918:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683681.889979:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7949450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+36:2403:x1876618835530496:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 230us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683681.889986:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:0.0:1789683681.890029:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:0.0:1789683681.890036:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+35:2403:x1876618835530624:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683681.890043:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683681.890049:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88ae07 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca30 expref: 35 pid: 18733 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683681.890059:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88ae07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca30 expref: 35 pid: 18733 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683681.890071:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88ae07 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca30 expref: 35 pid: 18733 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683681.890081:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:0.0:1789683681.890084:0:17185:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88aee0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683681.890090:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88aee0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683681.890097:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88aee0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683681.890124:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683681.890144:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+34:2403:x1876618835530624:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 108us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683681.890150:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 18 00010000:00010000:2.0:1789683681.891040:0:17202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88aee0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.891053:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88aee0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683681.891076:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1789683681.891226:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30600/0xcf8485587b88aed9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca76 expref: 35 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.891246:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88aee0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca76 expref: 34 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.891255:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:2.0:1789683681.891266:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789683681.891270:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30000, rc 0) 00000100:00100000:2.0:1789683681.891327:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+34:15688:x1876618835530368:12345-192.168.201.50@tcp:101:bash.0 Request processed in 16879us (17443us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1789683681.891334:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:1.0:1789683681.895325:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683681.895471:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835530880 00000100:00100000:3.0:1789683681.895482:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835530880 00000100:00100000:3.0:1789683681.895546:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 51 00000100:00100000:3.0:1789683681.895558:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+34:15688:x1876618835530880:12345-192.168.201.50@tcp:36:bash.0 00010000:00010000:3.0:1789683681.896085:0:18733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676800/0xcf8485587b88aeee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683681.896103:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676800/0xcf8485587b88aeee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683681.896114:0:18733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676800/0xcf8485587b88aeee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789683681.896155:0:18733:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1789683681.896176:0:18733:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044ce67e6 reply state 0000000040adc0bf transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676800/0xcf8485587b88aeee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683681.896187:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676800/0xcf8485587b88aeee lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683681.896194:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:3.0:1789683681.896197:0:18733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789683681.896201:0:18733:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789683681.896285:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+37:15688:x1876618835530880:12345-192.168.201.50@tcp:36:bash.0 Request processed in 728us (971us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1789683681.896292:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 51 00000020:00080000:3.0:1789683681.896310:0:18733:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789683681.899276:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683681.899583:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835531008 00000100:00100000:3.0:1789683681.899596:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835531008 00000100:00100000:3.0:1789683681.899700:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:3.0:1789683681.899713:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+37:15688:x1876618835531008:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789683681.899741:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683681.899764:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88aef5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca7d expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683681.899886:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88aef5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca7d expref: 38 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683681.899912:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88aef5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca7d expref: 38 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683681.899930:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:3.0:1789683681.899933:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789683681.899937:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81677200, rc 0) 00000100:00100000:3.0:1789683681.899997:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+38:15688:x1876618835531008:12345-192.168.201.50@tcp:101:bash.0 Request processed in 287us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683681.900004:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:1.0:1789683681.914672:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683681.914754:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835531136 00000100:00100000:2.0:1789683681.914766:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835531136 00000100:00100000:2.0:1789683681.914858:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:2.0:1789683681.914869:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+38:15688:x1876618835531136:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683681.914891:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683681.914923:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b88aefc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca84 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.915018:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af03 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.915035:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88aee0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca76 expref: 39 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.915044:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af03 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.915079:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88aee0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca76 expref: 39 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.915091:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88aee0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca76 expref: 39 pid: 17202 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683681.915103:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17201:1876618850291328:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683681.915206:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb85c9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683681.918465:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17201:1876618850291328:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683681.918495:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af03 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683681.925401:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683681.925592:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835531264 00000100:00100000:0.0:1789683681.925604:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835531264 00010000:00010000:0.0:1789683681.925652:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88aee0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca76 expref: 40 pid: 17202 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683681.926635:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:0.0:1789683681.926653:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e82fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+40:2402:x1876618835531264:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683681.926670:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683681.926678:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88aee0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca76 expref: 40 pid: 17202 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683681.926694:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88aee0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca76 expref: 40 pid: 17202 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683681.926716:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30000/0xcf8485587b88aee0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca76 expref: 40 pid: 17202 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683681.926733:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:0.0:1789683681.926739:0:17185:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af03 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683681.926750:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683681.926778:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af03 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683681.927114:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683681.927189:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+39:2402:x1876618835531264:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 533us (1789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683681.927198:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00010000:00010000:1.0:1789683681.927323:0:17201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.927332:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683681.927385:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789683681.927390:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789683681.927409:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.927441:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30c00/0xcf8485587b88aefc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca84 expref: 39 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.927473:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca84 expref: 38 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683681.927482:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:1.0:1789683681.927485:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683681.927495:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a31a00, rc 0) 00000100:00100000:1.0:1789683681.927523:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e82fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+38:15688:x1876618835531136:12345-192.168.201.50@tcp:101:bash.0 Request processed in 12656us (12863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683681.927530:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:1.0:1789683681.931041:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683681.931174:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835531520 00000100:00100000:2.0:1789683681.931195:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835531520 00000100:00100000:2.0:1789683681.931264:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:2.0:1789683681.931274:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+38:15688:x1876618835531520:12345-192.168.201.50@tcp:103:bash.0 00010000:00010000:2.0:1789683681.931290:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789683681.931316:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88aef5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca7d expref: 38 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.931339:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af03 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca84 expref: 37 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.931349:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:2.0:1789683681.931354:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683681.931417:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+36:15688:x1876618835531520:12345-192.168.201.50@tcp:103:bash.0 Request processed in 144us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683681.931424:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:1.0:1789683681.935089:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683681.935170:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835531648 00000100:00100000:2.0:1789683681.935253:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835531648 00000100:00100000:2.0:1789683681.935346:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:2.0:1789683681.935365:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+36:15688:x1876618835531648:12345-192.168.201.50@tcp:58:bash.0 00010000:00010000:2.0:1789683681.935490:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88af0a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.935521:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88af0a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683681.935533:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88af0a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789683681.937166:0:17202:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789683681.938001:0:17202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789683681.938149:0:17202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789683681.938338:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+36:15688:x1876618835531648:12345-192.168.201.50@tcp:58:bash.0 Request processed in 2977us (3253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683681.938349:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:1.0:1789683681.940671:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683681.940740:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835531776 00000100:00100000:3.0:1789683681.940750:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835531776 00000100:00100000:3.0:1789683681.940841:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:3.0:1789683681.940852:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+36:15688:x1876618835531776:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789683681.940872:0:18733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683681.940892:0:18733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88af11 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca8b expref: -99 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683681.940982:0:18733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88af0a lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683681.940994:0:18733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88af11 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca8b expref: 37 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683681.941015:0:18733:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88af0a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683681.941030:0:18733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88af11 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca8b expref: 37 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683681.941044:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:3.0:1789683681.941048:0:18733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789683681.941051:0:18733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88af11 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca8b expref: 37 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683681.941059:0:18733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81676400, rc 0) 00000100:00100000:3.0:1789683681.941115:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+37:15688:x1876618835531776:12345-192.168.201.50@tcp:101:bash.0 Request processed in 265us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683681.941123:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:1.0:1789683682.329440:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683682.329484:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683682.329518:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683682.329545:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683682.329568:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683682.329582:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683682.329597:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683682.329622:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683682.329652:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835532032 00000100:00100000:1.0:1789683682.329661:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835532032 00000100:00100000:1.0:1789683682.329715:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835532544 00000100:00100000:1.0:1789683682.329718:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835532544 00000100:00100000:1.0:1789683682.329733:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835532416 00000100:00100000:1.0:1789683682.329736:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835532416 00000100:00100000:1.0:1789683682.329754:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 71 00000100:00100000:1.0:1789683682.329764:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2403:x1876618835532032:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683682.329872:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2403:x1876618835532032:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 109us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683682.329880:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 71 00000100:00100000:1.0:1789683682.330007:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:1.0:1789683682.330014:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2403:x1876618835532544:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683682.330059:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2403:x1876618835532544:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 45us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683682.330065:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:1.0:1789683682.330079:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 73 00000100:00100000:1.0:1789683682.330085:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+12:2403:x1876618835532416:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789683682.330114:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+12:2403:x1876618835532416:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 29us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683682.330120:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 73 00000100:00100000:2.0:1789683682.333559:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835532288 00000100:00100000:2.0:1789683682.333575:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835532288 00000100:00100000:2.0:1789683682.333629:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835532800 00000100:00100000:2.0:1789683682.333632:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835532800 00000100:00100000:2.0:1789683682.333651:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835532160 00000100:00100000:2.0:1789683682.333654:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835532160 00000100:00100000:2.0:1789683682.333666:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835532672 00000100:00100000:2.0:1789683682.333668:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835532672 00000100:00100000:2.0:1789683682.333689:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:2.0:1789683682.333698:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2403:x1876618835532288:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683682.333777:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2403:x1876618835532288:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 79us (4291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683682.333846:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:2.0:1789683682.333866:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:2.0:1789683682.333873:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2403:x1876618835532800:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683682.334129:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2403:x1876618835532800:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 256us (4582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683682.334151:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:2.0:1789683682.334165:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:2.0:1789683682.334171:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2403:x1876618835532160:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683682.334199:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2403:x1876618835532160:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 28us (4615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683682.334205:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:2.0:1789683682.334219:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:2.0:1789683682.334225:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2403:x1876618835532672:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683682.334247:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2403:x1876618835532672:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 22us (4624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683682.334252:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:3.0:1789683682.334689:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835531904 00000100:00100000:3.0:1789683682.334696:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835531904 00000100:00100000:3.0:1789683682.334737:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 169 00000100:00100000:3.0:1789683682.334745:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:2403:x1876618835531904:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789683682.334772:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:2403:x1876618835531904:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 29us (5202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683682.334825:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 169 00000100:00080000:3.0:1789683682.334856:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789683682.334861:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789683682.334864:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683682.334867:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1789683682.337453:0:17236:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789683682.337461:0:17236:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789683682.337482:0:17236:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789683682.337488:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789683682.337624:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17236:1876618850291456:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789683682.337716:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fb85c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1789683682.346760:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17236:1876618850291456:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789683682.348650:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683682.349260:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835532928 00000100:00100000:1.0:1789683682.349271:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835532928 00000100:00100000:1.0:1789683682.349338:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:1.0:1789683682.349358:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+37:15689:x1876618835532928:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789683682.349391:0:17201:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789683682.349518:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+37:15689:x1876618835532928:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 170us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683682.349526:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:1.0:1789683682.359382:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683682.359463:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835533056 00000100:00100000:2.0:1789683682.359473:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835533056 00000100:00100000:2.0:1789683682.359535:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:2.0:1789683682.359546:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+37:15689:x1876618835533056:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789683682.359623:0:18733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af18 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.359657:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.359669:0:18733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.359735:0:18733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af1f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.359743:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.359748:0:18733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.359771:0:18733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88af26 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.359779:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88af26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.359826:0:18733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88af26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683682.359874:0:18733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789683682.359878:0:18733:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789683682.359907:0:18733:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88af26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.359918:0:18733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.359935:0:18733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af18 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.359941:0:18733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af18 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.359947:0:18733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683682.359951:0:18733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af18 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.359958:0:18733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af18 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.359969:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0fa0118100) 00010000:00010000:2.0:1789683682.359972:0:18733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683682.359976:0:18733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.359982:0:18733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.359994:0:18733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.360000:0:18733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af1f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.360006:0:18733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.360010:0:18733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683682.360017:0:18733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.360023:0:18733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af1f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.360030:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9f0f853e3100) 00010000:00010000:2.0:1789683682.360032:0:18733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683682.360035:0:18733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af1f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.360040:0:18733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af1f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.360055:0:18733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88af26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.360061:0:18733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88af26 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.360067:0:18733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88af26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.360072:0:18733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683682.360074:0:18733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88af26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.360080:0:18733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88af26 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.360086:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:2.0:1789683682.360088:0:18733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683682.360098:0:18733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88af26 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.360103:0:18733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31400/0xcf8485587b88af26 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683682.360192:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+37:15689:x1876618835533056:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 Request processed in 647us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683682.360200:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:3.0:1789683682.372735:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683682.373034:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835533312 00000100:00100000:1.0:1789683682.373046:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835533312 00000100:00100000:1.0:1789683682.373110:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:1.0:1789683682.373121:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+37:15689:x1876618835533312:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789683682.373144:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683682.373165:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9200/0xcf8485587b88af2d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca92 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683682.373413:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88af34 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683682.373430:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88af34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683682.373443:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88af34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683682.373455:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789683682.373536:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88af34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683682.373544:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88af34 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683682.373550:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88af34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683682.373556:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f9c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:1.0:1789683682.373560:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88af34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683682.373568:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88af34 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683682.373580:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:1.0:1789683682.373583:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683682.373587:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88af34 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683682.373603:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9c00/0xcf8485587b88af34 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683682.373643:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9200/0xcf8485587b88af2d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca92 expref: 39 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683682.373654:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0fa0118100) 00010000:00010000:1.0:1789683682.373656:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789683682.373660:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fa01f9200/0xcf8485587b88af2d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca92 expref: 39 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683682.373670:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fa01f9200, rc 0) 00000100:00100000:1.0:1789683682.373745:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+38:15689:x1876618835533312:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 625us (1018us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1789683682.373752:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:0.0:1789683682.376585:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683682.376679:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835533440 00000100:00100000:2.0:1789683682.376690:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835533440 00000100:00100000:2.0:1789683682.376749:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:2.0:1789683682.376759:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+38:15689:x1876618835533440:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789683682.376831:0:18733:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789683682.376962:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+38:15689:x1876618835533440:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 204us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683682.376970:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:2.0:1789683682.395102:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683682.395660:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835533696 00000100:00100000:3.0:1789683682.395672:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835533696 00000100:00100000:3.0:1789683682.395743:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:3.0:1789683682.395753:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+38:15689:x1876618835533696:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683682.395776:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683682.395833:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677000/0xcf8485587b88af42 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bca99 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789683682.396301:0:17202:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:3.0:1789683682.396308:0:17202:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:3.0:1789683682.396323:0:17202:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:3.0:1789683682.396484:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88af49 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.396499:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88af49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.396510:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88af49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.396565:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677000/0xcf8485587b88af42 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca99 expref: 41 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.396597:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88af49 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca99 expref: 40 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.396605:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0e81f6c800) 00010000:00010000:3.0:1789683682.396608:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683682.396612:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f81677200, rc 0) 00000100:00100000:3.0:1789683682.396671:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+40:15689:x1876618835533696:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 920us (1580us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1789683682.396679:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:1.0:1789683682.410314:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683682.410475:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835533952 00000100:00100000:2.0:1789683682.410486:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835533952 00000100:00100000:2.0:1789683682.410545:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:2.0:1789683682.410555:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+40:15689:x1876618835533952:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789683682.410613:0:18733:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683682.410641:0:18733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677200/0xcf8485587b88af49 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca99 expref: 40 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410662:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0e81f6c800) 00010000:00010000:2.0:1789683682.410673:0:18733:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683682.410712:0:18733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af57 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410728:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af57 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410738:0:18733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af57 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410752:0:18733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af5e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2627c3dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410760:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2627c3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410767:0:18733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2627c3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410864:0:18733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af57 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410871:0:18733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af57 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410877:0:18733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af57 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410882:0:18733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683682.410898:0:18733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af57 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410906:0:18733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af57 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410927:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0f853e3600) 00010000:00010000:2.0:1789683682.410929:0:18733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683682.410934:0:18733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af57 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410939:0:18733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af57 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410949:0:18733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2627c3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410954:0:18733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af5e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2627c3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410959:0:18733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af5e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2627c3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410964:0:18733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683682.410966:0:18733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af5e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2627c3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410972:0:18733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af5e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2627c3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410978:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x2627c3dd (ffff9f0f853e3100) 00010000:00010000:2.0:1789683682.410980:0:18733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683682.410982:0:18733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af5e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2627c3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.410987:0:18733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af5e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2627c3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683682.411083:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+39:15689:x1876618835533952:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 529us (779us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789683682.411090:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:2.0:1789683682.413513:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683682.419634:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835534080 00000100:00100000:3.0:1789683682.419652:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835534080 00000100:00100000:3.0:1789683682.419728:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 62 00000100:00100000:3.0:1789683682.419739:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+39:15689:x1876618835534080:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683682.419759:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683682.419984:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677000/0xcf8485587b88af65 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcaa0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.420051:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc3400/0xcf8485587b88af6c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.420063:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc3400/0xcf8485587b88af6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.420075:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc3400/0xcf8485587b88af6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.420253:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677000/0xcf8485587b88af65 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaa0 expref: 41 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.420281:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc3400/0xcf8485587b88af6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaa0 expref: 40 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.420290:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0e81f6c700) 00010000:00010000:3.0:1789683682.420293:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789683682.420297:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb1bc3400, rc 0) 00000100:00100000:3.0:1789683682.420477:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+40:15689:x1876618835534080:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 739us (6972us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683682.420485:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 62 00000100:00100000:1.0:1789683682.440124:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683682.440350:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835534336 00000100:00100000:2.0:1789683682.440361:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835534336 00000100:00100000:2.0:1789683682.440416:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:2.0:1789683682.440426:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+40:15689:x1876618835534336:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789683682.440508:0:18733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af73 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.440526:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.440538:0:18733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789683682.440776:0:18733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1789683682.440824:0:18733:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 596490039061ns, next at 597490035538ns, rc = 0 00000004:00010000:2.0:1789683682.440875:0:18733:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5c8dd13 reply state 000000005c2803eb transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.440899:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.440907:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0e81f6c700) 00010000:00010000:2.0:1789683682.440910:0:18733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789683682.440915:0:18733:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683682.441031:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+42:15689:x1876618835534336:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 606us (916us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1789683682.441038:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:1.0:1789683682.455703:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683682.455959:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835534464 00000100:00100000:2.0:1789683682.455972:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835534464 00000100:00100000:2.0:1789683682.456093:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:2.0:1789683682.456104:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+42:15689:x1876618835534464:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683682.456129:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683682.456153:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af7a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcaa7 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.456219:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af7a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaa7 expref: 43 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.456232:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af7a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaa7 expref: 43 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.456249:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0e81f6c700) 00010000:00010000:2.0:1789683682.456252:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683682.456256:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30200, rc 0) 00000100:00100000:2.0:1789683682.456318:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+43:15689:x1876618835534464:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 216us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683682.456324:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:0.0:1789683682.461486:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683682.461824:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835534592 00000100:00100000:1.0:1789683682.461834:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835534592 00000100:00100000:1.0:1789683682.461902:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:1.0:1789683682.461913:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2405:x1876618835534592:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789683682.462154:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+6:2405:x1876618835534592:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 242us (677us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789683682.462162:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:1.0:1789683682.467862:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683682.472834:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835534848 00000100:00100000:2.0:1789683682.472851:0:17203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835534848 00000100:00100000:2.0:1789683682.472938:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:2.0:1789683682.472951:0:17203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+43:15689:x1876618835534848:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789683682.473221:0:17203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+44:15689:x1876618835534848:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 273us (5369us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789683682.473229:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:0.0:1789683682.477006:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683682.477205:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835535104 00000100:00100000:2.0:1789683682.477214:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835535104 00000100:00100000:2.0:1789683682.477278:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:2.0:1789683682.477289:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e8451c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+44:15689:x1876618835535104:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789683682.477434:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e8451c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+44:15689:x1876618835535104:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 147us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683682.477442:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:0.0:1789683682.479759:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683682.479882:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835535232 00000100:00100000:3.0:1789683682.479901:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835535232 00000100:00100000:3.0:1789683682.479958:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 66 00000100:00100000:3.0:1789683682.479968:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fc0726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+44:15689:x1876618835535232:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683682.479987:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683682.480008:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2e00/0xcf8485587b88af81 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcaae expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.480074:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc3a00/0xcf8485587b88af88 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.480088:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc3a00/0xcf8485587b88af88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.480099:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc3a00/0xcf8485587b88af88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683682.480142:0:17202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789683682.480177:0:17202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc3a00/0xcf8485587b88af88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.480201:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2e00/0xcf8485587b88af81 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaae expref: 46 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.480219:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc3a00/0xcf8485587b88af88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaae expref: 45 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.480228:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0e81f6c700) 00010000:00010000:3.0:1789683682.480231:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789683682.480235:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb1bc3a00, rc 0) 00000100:00100000:3.0:1789683682.480296:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fc0726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+45:15689:x1876618835535232:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 329us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683682.480302:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 66 00000100:00100000:1.0:1789683682.489857:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683682.489958:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835535360 00000100:00100000:0.0:1789683682.489969:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835535360 00000100:00100000:0.0:1789683682.490044:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:0.0:1789683682.490057:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+6:2403:x1876618835535360:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683682.490076:0:19141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683682.490097:0:19141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b88af8f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcab5 expref: -99 pid: 19141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789683682.490125:0:19141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac67e2, blocks: 0x0 00010000:00010000:0.0:1789683682.490146:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=596s v=(0 0) 00010000:00010000:0.0:1789683682.490151:0:19141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683682.490160:0:19141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b88af8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcab5 expref: 7 pid: 19141 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.490191:0:19141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b88af8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcab5 expref: 7 pid: 19141 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.490223:0:19141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0f8454d400, rc 0) 00000100:00100000:0.0:1789683682.490287:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+7:2403:x1876618835535360:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 233us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683682.490294:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:3.0:1789683682.495074:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683682.495228:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835535616 00000100:00100000:2.0:1789683682.495239:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835535616 00000100:00100000:2.0:1789683682.495304:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:2.0:1789683682.495314:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+45:15689:x1876618835535616:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789683682.495418:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+45:15689:x1876618835535616:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 105us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683682.495426:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:1.0:1789683682.514577:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683682.515459:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835535744 00000100:00100000:3.0:1789683682.515471:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835535744 00000100:00100000:3.0:1789683682.515543:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 68 00000100:00100000:3.0:1789683682.515554:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+45:15689:x1876618835535744:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789683682.518752:0:17180:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:1.0:1789683682.518769:0:17180:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789683682.518875:0:17180:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1789683682.518998:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ada5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.519012:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ada5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.519020:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ada5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.519028:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0e837dbc00 already unused, calling callback (ffffffffc17e54f0) 00000100:00100000:2.0:1789683682.519041:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1789683682.519043:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ada5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.519051:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ada5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683682.519059:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850291584:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1789683682.519068:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0f853e3600) 00010000:00010000:3.0:1789683682.519070:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789683682.519075:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ada5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.519081:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0e837dbc00/0xcf8485587b88ada5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683682.519125:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683682.519169:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850291584 00000100:00100000:2.0:1789683682.519175:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850291584 00000100:00100000:2.0:1789683682.519223:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789683682.519231:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850291584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789683682.519357:0:18708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789683682.519366:0:18708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789683682.519368:0:18708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789683682.519370:0:18708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789683682 -> 1789683682 00002000:00010000:2.0:1789683682.519372:0:18708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1789683682.519440:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88ad51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519448:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88ad51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519454:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88ad51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519459:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683682.519462:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88ad51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519469:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88ad51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519478:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f0f853e3b00) 00010000:00010000:0.0:1789683682.519480:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683682.519483:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88ad51 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519488:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176600/0xcf8485587b88ad51 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519505:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88ad58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519518:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88ad58 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519524:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88ad58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519529:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb6176200 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683682.519532:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88ad58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519538:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88ad58 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519546:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0f853e3600) 00010000:00010000:0.0:1789683682.519548:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683682.519551:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88ad58 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519556:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb6176200/0xcf8485587b88ad58 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519570:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677800/0xcf8485587b88ae00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519575:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677800/0xcf8485587b88ae00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519581:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677800/0xcf8485587b88ae00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519585:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81677800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683682.519593:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677800/0xcf8485587b88ae00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519600:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677800/0xcf8485587b88ae00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683682.519607:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+19:15689:x1876618835535744:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 Request processed in 4053us (5039us total) trans 0 rc 0/0 00010000:00010000:0.0:1789683682.519607:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9f0e81f6cb00) 00010000:00010000:0.0:1789683682.519610:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683682.519612:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677800/0xcf8485587b88ae00 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683682.519616:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 68 00010000:00010000:0.0:1789683682.519618:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81677800/0xcf8485587b88ae00 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519643:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31e00/0xcf8485587b88ae85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519650:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31e00/0xcf8485587b88ae85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789683682.519654:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789683682.519655:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31e00/0xcf8485587b88ae85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519660:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683682.519663:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31e00/0xcf8485587b88ae85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519669:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31e00/0xcf8485587b88ae85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519676:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:0.0:1789683682.519678:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683682.519686:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31e00/0xcf8485587b88ae85 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519692:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31e00/0xcf8485587b88ae85 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519704:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88aea8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519711:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88aea8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519716:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88aea8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519731:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31600 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683682.519734:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88aea8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519739:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88aea8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519746:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:0.0:1789683682.519748:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683682.519751:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88aea8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519755:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31600/0xcf8485587b88aea8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519765:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676800/0xcf8485587b88aeee lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519769:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676800/0xcf8485587b88aeee lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519825:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676800/0xcf8485587b88aeee lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519831:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f81676800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683682.519833:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676800/0xcf8485587b88aeee lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519839:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676800/0xcf8485587b88aeee lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519847:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:0.0:1789683682.519849:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683682.519852:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676800/0xcf8485587b88aeee lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519858:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676800/0xcf8485587b88aeee lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519869:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519874:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af73 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519880:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519896:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31a00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:0.0:1789683682.519899:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519913:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af73 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519921:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0e81f6c700) 00010000:00010000:0.0:1789683682.519923:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789683682.519926:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af73 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.519931:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31a00/0xcf8485587b88af73 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683682.536840:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683682.536928:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876618850291584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 17695us (17800us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789683682.536941:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789683682.536973:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835535872 00000100:00100000:0.0:1789683682.536981:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835535872 00000100:00100000:0.0:1789683682.537024:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:0.0:1789683682.537033:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+7:2405:x1876618835535872:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789683682.537134:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+7:2405:x1876618835535872:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 Request processed in 101us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683682.537141:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 27 00000004:00080000:1.0:1789683682.537427:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0fb7961880/2, rc 0, transno 8589934596 00000100:00100000:1.0:1789683682.537436:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850291584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789683682.543715:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683682.543867:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835536128 00000100:00100000:2.0:1789683682.543878:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835536128 00000100:00100000:2.0:1789683682.543951:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:2.0:1789683682.543961:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+14:15689:x1876618835536128:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789683682.544014:0:18733:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683682.544041:0:18733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc3a00/0xcf8485587b88af88 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaae expref: 14 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.544059:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0e81f6c700) 00010000:00010000:2.0:1789683682.544064:0:18733:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683682.544092:0:18733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88af96 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.544106:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88af96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.544115:0:18733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88af96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683682.544241:0:18733:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000934ce42b reply state 000000004232e21c transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88af96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.544253:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30e00/0xcf8485587b88af96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.544258:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0e81f6c700) 00010000:00010000:2.0:1789683682.544276:0:18733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789683682.544279:0:18733:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683682.544381:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+15:15689:x1876618835536128:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 421us (675us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1789683682.544389:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:1.0:1789683682.564108:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683682.564300:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835536256 00000100:00100000:3.0:1789683682.564311:0:18710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835536256 00000100:00100000:3.0:1789683682.564621:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:3.0:1789683682.564633:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+7:15689:x1876618835536256:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683682.564652:0:18710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683682.564670:0:18710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082f0d4dd/0xcf8485587b88af9d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcabc expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.564703:0:18710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b88af8f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcab5 expref: 8 pid: 19141 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.564725:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683682.564730:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683682.564736:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082f0d4dd/0xcf8485587b88af9d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcabc expref: 8 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.564770:0:18710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b88af8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcab5 expref: 8 pid: 19141 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.564811:0:18710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b88af8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcab5 expref: 8 pid: 19141 timeout: 696 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683682.564828:0:18710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d61c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18710:1876618850291712:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789683682.564917:0:18710:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683682.577369:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683682.577700:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835536384 00000100:00100000:2.0:1789683682.577712:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835536384 00010000:00010000:2.0:1789683682.577763:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b88af8f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcab5 expref: 9 pid: 19141 timeout: 696 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683682.577832:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:2.0:1789683682.577842:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+9:2403:x1876618835536384:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683682.577858:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683682.577880:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b88af8f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcab5 expref: 9 pid: 19141 timeout: 696 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.577908:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b88af8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcab5 expref: 9 pid: 19141 timeout: 696 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.577935:0:17187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683682.577940:0:17187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683682.577946:0:17187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082f0d4dd/0xcf8485587b88af9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcabc expref: 9 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.577956:0:17187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082f0d4dd/0xcf8485587b88af9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcabc expref: 9 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.578016:0:17187:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000082f0d4dd/0xcf8485587b88af9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcabc expref: 9 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683682.578030:0:17187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17187:1876618850291840:192.168.201.50@tcp:105: 00000100:00100000:2.0:1789683682.578100:0:17187:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc1500f00 going to sleep for 11 seconds 00010000:00010000:3.0:1789683682.578605:0:18710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcce9594/0xcf8485587b88af8f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcab5 expref: 9 pid: 19141 timeout: 696 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683682.578623:0:18710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d61c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18710:1876618850291712:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789683682.578647:0:18710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000082f0d4dd/0xcf8485587b88af9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcabc expref: 8 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.578659:0:18710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb1bc2e00, rc 0) 00000100:00100000:3.0:1789683682.578691:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+8:15689:x1876618835536256:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 14061us (14593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683682.578712:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:2.0:1789683682.581822:0:17187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17187:1876618850291840:192.168.201.50@tcp:105: 00010000:00010000:2.0:1789683682.581848:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683682.581908:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+7:2403:x1876618835536384:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 4066us (4547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683682.581920:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:1.0:1789683682.591662:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683682.591696:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835536512 00000100:00100000:3.0:1789683682.591705:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835536512 00000100:00100000:3.0:1789683682.591774:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:3.0:1789683682.591809:0:18709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+7:2402:x1876618835536512:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789683682.591980:0:18709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789683682.591984:0:18709:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789683682 00002000:00010000:3.0:1789683682.591987:0:18709:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789683680 00002000:00010000:3.0:1789683682.591989:0:18709:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789683682 -> 1789683682 00002000:00010000:3.0:1789683682.591991:0:18709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789683682.592047:0:18709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+8:2402:x1876618835536512:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 264us (393us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789683682.592055:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:0.0:1789683682.599129:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683682.599279:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835536640 00000100:00100000:1.0:1789683682.599289:0:18708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835536640 00000100:00100000:1.0:1789683682.599358:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:1.0:1789683682.599367:0:18708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+8:2402:x1876618835536640:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789683682.599416:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000783ae124/0xcf8485587b88afa4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683682.599436:0:18708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000082f0d4dd/0xcf8485587b88af9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcabc expref: 8 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683682.599444:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683682.599449:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789683682.599453:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000783ae124/0xcf8485587b88afa4 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683682.599487:0:18708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000082f0d4dd/0xcf8485587b88af9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcabc expref: 8 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683682.599538:0:18708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000082f0d4dd/0xcf8485587b88af9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcabc expref: 8 pid: 18710 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683682.599553:0:18708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7dbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18708:1876618850291968:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789683682.599632:0:18708:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f8a28e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683682.603399:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683682.603521:0:18708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7dbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18708:1876618850291968:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683682.603553:0:18708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000783ae124/0xcf8485587b88afa4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683682.603841:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835536768 00000100:00100000:3.0:1789683682.603849:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835536768 00010000:00010000:3.0:1789683682.603902:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000082f0d4dd/0xcf8485587b88af9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcabc expref: 9 pid: 18710 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683682.603934:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:3.0:1789683682.603944:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+9:2403:x1876618835536768:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683682.603959:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683682.603982:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082f0d4dd/0xcf8485587b88af9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcabc expref: 9 pid: 18710 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.603995:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082f0d4dd/0xcf8485587b88af9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcabc expref: 9 pid: 18710 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.604035:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082f0d4dd/0xcf8485587b88af9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcabc expref: 9 pid: 18710 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.604051:0:17185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683682.604056:0:17185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683682.604061:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000783ae124/0xcf8485587b88afa4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.604071:0:17185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000783ae124/0xcf8485587b88afa4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.604102:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683682.604159:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+8:2403:x1876618835536768:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 216us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683682.604166:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00010000:00010000:2.0:1789683682.604330:0:18708:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000783ae124/0xcf8485587b88afa4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.604340:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000783ae124/0xcf8485587b88afa4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.604360:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000783ae124/0xcf8485587b88afa4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.604380:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000783ae124/0xcf8485587b88afa4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.604389:0:18708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000783ae124/0xcf8485587b88afa4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.604397:0:18708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fa01f8800 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683682.604401:0:18708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000783ae124/0xcf8485587b88afa4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.604410:0:18708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000783ae124/0xcf8485587b88afa4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.604424:0:18708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000783ae124/0xcf8485587b88afa4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.604432:0:18708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000783ae124/0xcf8485587b88afa4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683682.604483:0:18708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+8:2402:x1876618835536640:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 Request processed in 5117us (5364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683682.604491:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:2.0:1789683682.607330:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683682.615073:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835537024 00000100:00100000:1.0:1789683682.615089:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835537024 00000100:00100000:2.0:1789683682.618164:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 70 00000100:00100000:2.0:1789683682.618187:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+15:15689:x1876618835537024:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789683682.618300:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88afab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.618318:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31000/0xcf8485587b88ae7e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca5a expref: 15 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.618328:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88afab lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.618608:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31000/0xcf8485587b88ae7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca5a expref: 15 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.618626:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31000/0xcf8485587b88ae7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca5a expref: 15 pid: 17202 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683682.618641:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17201:1876618850292096:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789683682.618745:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc1500f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683682.620728:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17201:1876618850292096:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789683682.620758:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88afab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683682.621263:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683682.621521:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835537152 00000100:00100000:0.0:1789683682.621529:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835537152 00010000:00010000:0.0:1789683682.621567:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31000/0xcf8485587b88ae7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca5a expref: 16 pid: 17202 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683682.621634:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:0.0:1789683682.621645:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+16:2402:x1876618835537152:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683682.621662:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683682.621670:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31000/0xcf8485587b88ae7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca5a expref: 16 pid: 17202 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.621682:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31000/0xcf8485587b88ae7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca5a expref: 16 pid: 17202 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.621702:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31000/0xcf8485587b88ae7e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca5a expref: 16 pid: 17202 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.621719:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:0.0:1789683682.621726:0:17187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88af11 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca8b expref: 15 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.621736:0:17187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88afab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.621743:0:17187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88afab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.621751:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88afab lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.621781:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683682.621948:0:17201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88afab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.621956:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88afab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.622177:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2c00/0xcf8485587b88afb2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.622190:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af7a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaa7 expref: 16 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.622209:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2c00/0xcf8485587b88afb2 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.622238:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af7a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaa7 expref: 16 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.622251:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af7a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaa7 expref: 16 pid: 17201 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683682.622264:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17201:1876618850292224:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789683682.622346:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683682.622424:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+16:2402:x1876618835537152:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 781us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683682.622439:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:1.0:1789683682.628252:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683682.628404:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17201:1876618850292224:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789683682.628436:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2c00/0xcf8485587b88afb2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683682.629110:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835537280 00000100:00100000:0.0:1789683682.629121:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835537280 00010000:00010000:0.0:1789683682.629162:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af7a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaa7 expref: 16 pid: 17201 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683682.629314:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:0.0:1789683682.629323:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb794bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+16:2403:x1876618835537280:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683682.629340:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683682.629449:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af7a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaa7 expref: 16 pid: 17201 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.629462:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af7a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaa7 expref: 16 pid: 17201 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.629483:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30200/0xcf8485587b88af7a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaa7 expref: 16 pid: 17201 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.629500:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0e81f6c700) 00010000:00010000:0.0:1789683682.629573:0:17185:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2c00/0xcf8485587b88afb2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.629585:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2c00/0xcf8485587b88afb2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.629593:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2c00/0xcf8485587b88afb2 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.629679:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683682.629742:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb794bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+15:2403:x1876618835537280:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 419us (1499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683682.629749:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00010000:00010000:3.0:1789683682.636159:0:17201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2c00/0xcf8485587b88afb2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.636185:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2c00/0xcf8485587b88afb2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789683682.636452:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1789683682.636589:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1789683682.636623:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1789683682.636696:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17201:1876618850292352:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789683682.636764:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683682.637040:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850292352 00000100:00100000:3.0:1789683682.637048:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850292352 00000100:00100000:3.0:1789683682.637096:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789683682.637104:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17201:x1876618850292352:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789683682.641054:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17201:x1876618850292352:12345-0@lo:1000:mdt00_001.0 Request processed in 3940us (4281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683682.641087:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789683682.641640:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc1500cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683682.641675:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17201:1876618850292352:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789683682.642444:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1789683682.642593:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83caf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17201:1876618850292480:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789683682.642645:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683682.642677:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0fc1500480 going to sleep for 11 seconds 00000100:00100000:0.0:1789683682.642743:0:17941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850292480 00000100:00100000:0.0:1789683682.642751:0:17941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850292480 00000100:00100000:0.0:1789683682.642848:0:17941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789683682.642858:0:17941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17201:x1876618850292480:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789683682.643015:0:17941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17201:x1876618850292480:12345-0@lo:1000:mdt00_001.0 Request processed in 158us (369us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789683682.643023:0:17941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789683682.643627:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83caf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17201:1876618850292480:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789683682.643673:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2c00/0xcf8485587b88afb2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.643684:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2c00/0xcf8485587b88afb2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.643692:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2c00/0xcf8485587b88afb2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.643698:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683682.643703:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2c00/0xcf8485587b88afb2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.643711:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2c00/0xcf8485587b88afb2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.643726:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0e81f6c700) 00010000:00010000:2.0:1789683682.643729:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683682.643735:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2c00/0xcf8485587b88afb2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.643741:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2c00/0xcf8485587b88afb2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.643776:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88af0a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.644415:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88af0a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.644422:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88af0a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.644428:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683682.644432:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88af0a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.644439:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88af0a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.644448:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:2.0:1789683682.644451:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683682.644458:0:17201:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88af11 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca8b expref: 18 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.644469:0:17201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88af11 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca8b expref: 18 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.644479:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88af11 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca8b expref: 18 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.644665:0:17201:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f81676400/0xcf8485587b88af11 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bca8b expref: 18 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683682.644682:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17201:1876618850292608:192.168.201.50@tcp:105: 00000100:00100000:3.0:1789683682.645371:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0f85ea0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683682.655640:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683682.655740:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7998380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17201:1876618850292608:192.168.201.50@tcp:105: 00010000:00010000:3.0:1789683682.655770:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88af0a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.655825:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88af0a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.655872:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2e00/0xcf8485587b88afb9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.655895:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2e00/0xcf8485587b88afb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.655906:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2e00/0xcf8485587b88afb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.655917:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2e00/0xcf8485587b88afb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.655923:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2e00/0xcf8485587b88afb9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.655929:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2e00/0xcf8485587b88afb9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.655953:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb1bc2e00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683682.655957:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2e00/0xcf8485587b88afb9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.655964:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2e00/0xcf8485587b88afb9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.655975:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:3.0:1789683682.655978:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683682.655981:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2e00/0xcf8485587b88afb9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.655987:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2e00/0xcf8485587b88afb9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.655996:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88afab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.656001:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88afab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.656007:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88afab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.656012:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:3.0:1789683682.656015:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88afab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.656020:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88afab lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.656038:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:3.0:1789683682.656040:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789683682.656043:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88afab lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.656049:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88afab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683682.656231:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+18:15689:x1876618835537024:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 38046us (48910us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1789683682.656242:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 70 00000020:00080000:3.0:1789683682.656248:0:17201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789683682.656729:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835537408 00000100:00100000:0.0:1789683682.656737:0:17204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835537408 00000100:00100000:0.0:1789683682.656823:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:0.0:1789683682.656834:0:17204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+18:15688:x1876618835537408:12345-192.168.201.50@tcp:49:bash.0 00000100:00100000:0.0:1789683682.656941:0:17204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+18:15688:x1876618835537408:12345-192.168.201.50@tcp:49:bash.0 Request processed in 109us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683682.656948:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 12 00000040:00080000:2.0:1789683682.657474:0:17236:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789683682.657480:0:17236:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789683682.657496:0:17236:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789683682.657512:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789683682.667187:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789683682.667231:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683682.667310:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835537664 00000100:00100000:3.0:1789683682.667321:0:18709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835537664 00000100:00100000:3.0:1789683682.667389:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:3.0:1789683682.667400:0:18709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+7:15688:x1876618835537664:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789683682.667418:0:18709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683682.667441:0:18709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082f0d4dd/0xcf8485587b88afc0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcac3 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683682.667468:0:18709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aac67e2, atime: 0x6aac67e0, ctime: 0x6aac67e2, blocks: 0x0 00010000:00010000:3.0:1789683682.667491:0:18709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=596s v=(0 0) 00010000:00010000:3.0:1789683682.667496:0:18709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683682.667517:0:18709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082f0d4dd/0xcf8485587b88afc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcac3 expref: 8 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.667535:0:18709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000082f0d4dd/0xcf8485587b88afc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcac3 expref: 8 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.667565:0:18709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb1bc2e00, rc 0) 00000100:00100000:3.0:1789683682.667626:0:18709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+8:15688:x1876618835537664:12345-192.168.201.50@tcp:101:bash.0 Request processed in 227us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683682.667634:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:0.0:1789683682.668133:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835537792 00000100:00100000:0.0:1789683682.668140:0:17204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835537792 00000100:00100000:0.0:1789683682.668180:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:0.0:1789683682.668188:0:17204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+18:15689:x1876618835537792:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789683682.668459:0:17204:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789683682.668491:0:17204:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1789683682.668535:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c400/0xcf8485587b88afc7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.668560:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c400/0xcf8485587b88afc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.668571:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c400/0xcf8485587b88afc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.668581:0:17204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c400/0xcf8485587b88afc7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.668586:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c400/0xcf8485587b88afc7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.668592:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c400/0xcf8485587b88afc7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683682.668614:0:17204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789683682.668688:0:17204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+20:15689:x1876618835537792:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 500us (1455us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1789683682.668696:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00000020:00080000:0.0:1789683682.668700:0:17204:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789683682.668832:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683682.668844:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c400/0xcf8485587b88afc7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.668851:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0f8454c400 already unused, calling callback (ffffffffc0b9a8b0) 00010000:00010000:2.0:1789683682.668855:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c400/0xcf8485587b88afc7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.668862:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c400/0xcf8485587b88afc7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.668873:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0e81f6c700) 00010000:00010000:2.0:1789683682.668877:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789683682.668892:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c400/0xcf8485587b88afc7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.668898:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0f8454c400/0xcf8485587b88afc7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.668911:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683682.668913:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683682.668915:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683682.670308:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683682.670425:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835537920 00000100:00100000:2.0:1789683682.670434:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835537920 00000100:00100000:2.0:1789683682.670487:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 71 00000100:00100000:2.0:1789683682.670497:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+20:15688:x1876618835537920:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789683682.670526:0:18733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683682.670545:0:18733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88afce lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcaca expref: -99 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.670578:0:18733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88afd5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.670608:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88afd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.670619:0:18733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88afd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.670726:0:18733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88afce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaca expref: 22 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.670744:0:18733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30a00/0xcf8485587b88afd5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcaca expref: 21 pid: 18733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.670752:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:2.0:1789683682.670755:0:18733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789683682.670759:0:18733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb7a30a00, rc 0) 00000100:00100000:2.0:1789683682.670854:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+21:15688:x1876618835537920:12345-192.168.201.50@tcp:101:bash.0 Request processed in 358us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683682.670861:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 71 00000100:00100000:1.0:1789683682.677259:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789683682.677369:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835538176 00000100:00100000:0.0:1789683682.677379:0:17204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835538176 00000100:00100000:0.0:1789683682.677434:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:0.0:1789683682.677445:0:17204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+21:15688:x1876618835538176:12345-192.168.201.50@tcp:35:bash.0 00000001:00080000:0.0:1789683682.677679:0:17204:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:0.0:1789683682.677764:0:17204:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:0.0:1789683682.678214:0:17204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1acf7a90-98f6-4b44-899e-7c61b5867591+24:15688:x1876618835538176:12345-192.168.201.50@tcp:35:bash.0 Request processed in 769us (962us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1789683682.678223:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 14 00000020:00080000:0.0:1789683682.678235:0:17204:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789683682.805835:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683682.805921:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835538432 00000100:00100000:3.0:1789683682.805931:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835538432 00000100:00100000:3.0:1789683682.806005:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:3.0:1789683682.806016:0:17202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+24:15699:x1876618835538432:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789683682.806042:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683682.806061:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2a00/0xcf8485587b88afdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a5b62327e3bcad1 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683682.806157:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789683682.806254:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2a00/0xcf8485587b88afdc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcad1 expref: 26 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.806267:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0fa0118f00) 00010000:00010000:3.0:1789683682.806270:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683682.806275:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb1bc2a00/0xcf8485587b88afdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x6a5b62327e3bcad1 expref: 26 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683682.806288:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0fb1bc2a00, rc 0) 00000100:00100000:3.0:1789683682.808820:0:17202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+25:15699:x1876618835538432:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 2784us (2972us total) trans 8589934634 rc 301/301 00000100:00100000:3.0:1789683682.808833:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:1.0:1789683682.817750:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683682.817987:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835538560 00000100:00100000:2.0:1789683682.817996:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835538560 00000100:00100000:2.0:1789683682.818047:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 73 00000100:00100000:2.0:1789683682.818056:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+25:15699:x1876618835538560:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:2.0:1789683682.818127:0:18733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88afea lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818142:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88afea lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818168:0:18733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88afea lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818186:0:18733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88aff1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818192:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88aff1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818199:0:18733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88aff1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818270:0:18733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88aff8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818276:0:18733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88aff8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818281:0:18733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88aff8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683682.818316:0:18733:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88aff8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818324:0:18733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88afea lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818329:0:18733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88afea lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818333:0:18733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88afea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818347:0:18733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a31c00 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683682.818351:0:18733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88afea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818358:0:18733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88afea lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818369:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0f853e3600) 00010000:00010000:2.0:1789683682.818372:0:18733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683682.818377:0:18733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88afea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818383:0:18733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a31c00/0xcf8485587b88afea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818396:0:18733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88aff1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818401:0:18733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88aff1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818405:0:18733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88aff1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818408:0:18733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30800 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683682.818410:0:18733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88aff1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818413:0:18733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88aff1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818425:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9f0f853e3100) 00010000:00010000:2.0:1789683682.818427:0:18733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683682.818429:0:18733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88aff1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.818432:0:18733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30800/0xcf8485587b88aff1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.819639:0:18733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88aff8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.819651:0:18733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88aff8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.819657:0:18733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88aff8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.819663:0:18733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0fb7a30400 already unused, calling callback (ffffffffc17e54f0) 00010000:00010000:2.0:1789683682.819667:0:18733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88aff8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.819673:0:18733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88aff8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.819685:0:18733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0e81f6c500) 00010000:00010000:2.0:1789683682.819688:0:18733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683682.819691:0:18733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88aff8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683682.819697:0:18733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0fb7a30400/0xcf8485587b88aff8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683682.820028:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+25:15699:x1876618835538560:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 1969us (2281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683682.820039:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 73 00000100:00100000:1.0:1789683682.822082:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683682.822183:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835538816 00000100:00100000:3.0:1789683682.822192:0:17203:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835538816 00000100:00100000:3.0:1789683682.822374:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:3.0:1789683682.822386:0:17203:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+25:15699:x1876618835538816:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789683682.822644:0:17203:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+26:15699:x1876618835538816:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 261us (570us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1789683682.822649:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 15 00010000:00010000:3.0:1789683682.852743:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683683.880381:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683683.938709:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850292736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683683.938802:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683683.938872:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850292736 00000100:00100000:0.0:1789683683.938881:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850292736 00000100:00100000:0.0:1789683683.938929:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789683683.938937:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1876618850292736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683683.938969:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789683683.939016:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1876618850292736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683683.939023:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789683683.939076:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850292736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683683.948218:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850292992:0@lo:400:kworker.0 00000100:00100000:0.0:1789683683.948292:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683683.948340:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850293504:0@lo:400:kworker.0 00000100:00100000:0.0:1789683683.948366:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683683.948384:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850294016:0@lo:400:kworker.0 00000100:00100000:0.0:1789683683.948409:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683683.948686:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789683683.948695:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e82fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850293120:0@lo:400:kworker.0 00000100:00100000:0.0:1789683683.948733:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683683.948752:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850293632:0@lo:400:kworker.0 00000100:00100000:0.0:1789683683.948774:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683683.948819:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850294144:0@lo:400:kworker.0 00000100:00100000:0.0:1789683683.948840:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683683.948906:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850292992 00000100:00100000:0.0:1789683683.948914:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850292992 00000100:00100000:0.0:1789683683.948962:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789683683.948970:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850292992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683683.949027:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850292992:12345-0@lo:400:kworker.0 Request processed in 58us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683683.949034:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789683683.949058:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850293504 00000100:00100000:0.0:1789683683.949063:0:18710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850293504 00000100:00100000:0.0:1789683683.949093:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850293120 00000100:00100000:0.0:1789683683.949096:0:18710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850293120 00000100:00100000:0.0:1789683683.949109:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850293632 00000100:00100000:0.0:1789683683.949111:0:18710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850293632 00000100:00100000:0.0:1789683683.949126:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789683683.949132:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850293504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683683.949176:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850293504:12345-0@lo:400:kworker.0 Request processed in 43us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683683.949181:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789683683.949193:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789683683.949198:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850293120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683683.949220:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876618850293120:12345-0@lo:400:kworker.0 Request processed in 23us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683683.949225:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789683683.949233:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789683683.949238:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850293632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683683.949260:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850293632:12345-0@lo:400:kworker.0 Request processed in 22us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683683.949265:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789683683.949294:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850294016 00000100:00100000:0.0:1789683683.949298:0:17202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850294016 00000100:00100000:2.0:1789683683.949764:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850294144 00000100:00100000:2.0:1789683683.949769:0:17201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850294144 00000100:00100000:2.0:1789683683.949811:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789683683.949819:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850294016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683683.949857:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876618850294016:12345-0@lo:400:kworker.0 Request processed in 39us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683683.949873:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789683683.949887:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789683683.949893:0:17201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850294144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683683.949920:0:17201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876618850294144:12345-0@lo:400:kworker.0 Request processed in 28us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683683.949925:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1789683683.950235:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683683.950241:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789683683.950244:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789683683.950246:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683683.950263:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb6173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850292864:0@lo:400:kworker.0 00000100:00100000:3.0:1789683683.950299:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683683.950344:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850293376:0@lo:400:kworker.0 00000100:00100000:3.0:1789683683.950366:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683683.950382:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850293888:0@lo:400:kworker.0 00000100:00100000:3.0:1789683683.950400:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683683.950412:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850294400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789683683.950429:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683683.950904:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789683683.950912:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850293248:0@lo:400:kworker.0 00000100:00100000:3.0:1789683683.950938:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683683.950954:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fb7a13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850293760:0@lo:400:kworker.0 00000100:00100000:3.0:1789683683.950972:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683683.951001:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850294272:0@lo:400:kworker.0 00000100:00100000:3.0:1789683683.951022:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683683.951047:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850293376 00000100:00100000:3.0:1789683683.951053:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850293376 00000100:00100000:3.0:1789683683.951087:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789683683.951094:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb7998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850293376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683683.951133:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb7998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850293376:12345-0@lo:400:kworker.0 Request processed in 40us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683683.951139:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789683683.952616:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850293888 00000100:00100000:3.0:1789683683.952628:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850293888 00000100:00100000:3.0:1789683683.952667:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850293248 00000100:00100000:3.0:1789683683.952670:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850293248 00000100:00100000:3.0:1789683683.952680:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850293760 00000100:00100000:3.0:1789683683.952682:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850293760 00000100:00100000:3.0:1789683683.952692:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850294272 00000100:00100000:3.0:1789683683.952694:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850294272 00000100:00100000:3.0:1789683683.952711:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789683683.952718:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850293888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683683.952814:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876618850293888:12345-0@lo:400:kworker.0 Request processed in 97us (2413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683683.952821:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789683683.952836:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789683683.952842:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850293248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683683.952881:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876618850293248:12345-0@lo:400:kworker.0 Request processed in 40us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683683.952887:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789683683.952899:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789683683.952915:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850293760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683683.952946:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876618850293760:12345-0@lo:400:kworker.0 Request processed in 33us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683683.952952:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789683683.952963:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789683683.952969:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850294272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683683.952996:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876618850294272:12345-0@lo:400:kworker.0 Request processed in 27us (1972us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683683.953001:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1789683683.953017:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789683683.953020:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683683.953030:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850294400 00000100:00100000:3.0:1789683683.953034:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850294400 00000100:00100000:3.0:1789683683.953063:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789683683.953070:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850294400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789683683.953085:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789683683.953118:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876618850294400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (2687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683683.953124:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789683683.954485:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850292864 00000100:00100000:2.0:1789683683.954497:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850292864 00000100:00100000:2.0:1789683683.954545:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789683683.954553:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3650:x1876618850292864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683683.954616:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7+24:3650:x1876618850292864:12345-0@lo:400:kworker.0 Request processed in 64us (4315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683683.954623:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789683683.955586:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850293120:0@lo:400:kworker.0 00000100:00100000:0.0:1789683683.955613:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850293632:0@lo:400:kworker.0 00000100:00100000:0.0:1789683683.955626:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1876618850294144:0@lo:400:kworker.0 00000100:00100000:0.0:1789683683.955637:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e82fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1876618850292992:0@lo:400:kworker.0 00000100:00100000:0.0:1789683683.955647:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850293504:0@lo:400:kworker.0 00010000:00080000:0.0:1789683683.955662:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0fb7a11880 x1876618850294016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683683.955672:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1876618850294016:0@lo:400:kworker.0 00000100:00100000:3.0:1789683683.957635:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876618850293248:0@lo:400:kworker.0 00000100:00100000:3.0:1789683683.957656:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876618850293760:0@lo:400:kworker.0 00010000:00080000:3.0:1789683683.957670:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0e83f14e00 x1876618850294272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683683.957682:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1876618850294272:0@lo:400:kworker.0 00000100:00100000:3.0:1789683683.957695:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb6173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e5e0833-60b8-4f67-ab09-c7aa3b4baab7:3650:1876618850292864:0@lo:400:kworker.0 00000100:00100000:3.0:1789683683.957718:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850293376:0@lo:400:kworker.0 00000100:00100000:3.0:1789683683.957729:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fb7a10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1876618850293888:0@lo:400:kworker.0 00000100:00100000:3.0:1789683683.957748:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1876618850294400:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1789683684.862696:0:20379:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:0.0:1789683684.900408:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683685.919198:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683685.919687:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789683685.919737:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683685.920253:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835539072 00000100:00100000:2.0:1789683685.920266:0:18710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835539072 00000100:00100000:2.0:1789683685.920355:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 32 00000100:00100000:2.0:1789683685.920365:0:18710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb6173800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+8:2403:x1876618835539072:12345-192.168.201.50@tcp:16:kworker.0 00000100:00100000:2.0:1789683685.920490:0:18710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb6173800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1acf7a90-98f6-4b44-899e-7c61b5867591+8:2403:x1876618835539072:12345-192.168.201.50@tcp:16:kworker.0 Request processed in 127us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683685.920498:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 32 00000100:00100000:0.0:1789683685.921050:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835538944 00000100:00100000:0.0:1789683685.921057:0:18713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835538944 00002000:00100000:0.0:1789683685.921085:0:18713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9f0fa7d61c00 x1876618835538944/t0(0) o4->1acf7a90-98f6-4b44-899e-7c61b5867591@192.168.201.50@tcp:741/0 lens 504/0 e 0 to 0 dl 1789683696 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789683685.921096:0:18713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0fa7d61c00 with x1876618835538944 ext(0->8) 00002000:00010000:0.0:1789683685.921102:0:18713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f0fa7d61c00 00000100:00100000:0.0:1789683685.921130:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:0.0:1789683685.921138:0:18713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+8:2403:x1876618835538944:12345-192.168.201.50@tcp:4:bash.0 00000100:00080000:3.0:1789683685.922423:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683685.923271:0:18713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+10:2403:x1876618835538944:12345-192.168.201.50@tcp:4:bash.0 Request processed in 2126us (3583us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789683685.923283:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 0 00002000:00100000:0.0:1789683685.923296:0:18713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9f0fa7d61c00 x1876618835538944/t8589934599(0) o4->1acf7a90-98f6-4b44-899e-7c61b5867591@192.168.201.50@tcp:741/0 lens 504/448 e 0 to 0 dl 1789683696 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789683685.923322:0:18713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0fa7d61c00 with x1876618835538944 ext(0->8) 00002000:00010000:0.0:1789683685.923328:0:18713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f0fa7d61c00 00000100:00100000:1.0:1789683685.985147:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683685.985169:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850294528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789683685.985239:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683685.985378:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850294528 00000100:00100000:3.0:1789683685.985398:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850294528 00000100:00100000:3.0:1789683685.985457:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789683685.985467:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fa7dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850294528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789683685.985502:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1789683685.985547:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fa7dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876618850294528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683685.985554:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789683685.986769:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683685.986846:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850294656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789683685.986905:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683685.987226:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850294656 00000100:00100000:2.0:1789683685.987234:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850294656 00000100:00100000:2.0:1789683685.987291:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789683685.987300:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850294656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789683685.987326:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789683685.987370:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876618850294656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683685.987376:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789683685.987438:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1876618850294656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789683685.988869:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1876618850294528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789683685.989169:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0e83cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850294784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789683685.989238:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683685.990951:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850294784 00000100:00100000:1.0:1789683685.990966:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850294784 00000100:00100000:1.0:1789683685.991044:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789683685.991055:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850294784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789683685.991110:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789683685.991198:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876618850294784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683685.991205:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1789683685.991317:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683685.991596:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0e83cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1876618850294784:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1789683686.751441:0:17236:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789683686.751450:0:17236:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789683686.751472:0:17236:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789683686.751481:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789683686.944319:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683687.008046:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0fa7dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850294912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683687.008131:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683687.008290:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618850294912 00000100:00100000:3.0:1789683687.008298:0:18711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618850294912 00000100:00100000:3.0:1789683687.008366:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789683687.008376:0:18711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fb61f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850294912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683687.008396:0:18711:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789683687.008443:0:18711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fb61f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876618850294912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683687.008450:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789683687.008514:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0fa7dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1876618850294912:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789683687.008612:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683687.460054:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683687.460084:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683687.460105:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683687.460125:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683687.460144:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683687.460163:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683687.460179:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683687.460221:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683687.460240:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789683687.460266:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835539456 00000100:00100000:2.0:1789683687.460279:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835539456 00000100:00100000:2.0:1789683687.460339:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835539328 00000100:00100000:2.0:1789683687.460342:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835539328 00000100:00100000:2.0:1789683687.460355:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835539968 00000100:00100000:2.0:1789683687.460358:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835539968 00000100:00100000:2.0:1789683687.460367:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835539840 00000100:00100000:2.0:1789683687.460369:0:17200:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835539840 00000100:00100000:2.0:1789683687.460384:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 80 00000100:00100000:2.0:1789683687.460393:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2403:x1876618835539456:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683687.460469:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2403:x1876618835539456:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 77us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683687.460477:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 80 00000100:00100000:2.0:1789683687.460494:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 81 00000100:00100000:2.0:1789683687.460500:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+26:2403:x1876618835539328:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683687.460529:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1acf7a90-98f6-4b44-899e-7c61b5867591+26:2403:x1876618835539328:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 29us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683687.460535:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 81 00000100:00100000:2.0:1789683687.460545:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 82 00000100:00100000:2.0:1789683687.460549:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2402:x1876618835539968:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683687.460566:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2402:x1876618835539968:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 17us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683687.460570:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 82 00000100:00100000:2.0:1789683687.460575:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 83 00000100:00100000:2.0:1789683687.460584:0:17200:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:2402:x1876618835539840:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683687.460599:0:17200:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+6:2402:x1876618835539840:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 16us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683687.460603:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 83 00000100:00100000:2.0:1789683687.460617:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835539712 00000100:00100000:2.0:1789683687.460619:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835539712 00000100:00100000:2.0:1789683687.460631:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835539584 00000100:00100000:2.0:1789683687.460632:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835539584 00000100:00100000:2.0:1789683687.460639:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835540096 00000100:00100000:2.0:1789683687.460641:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835540096 00000100:00100000:2.0:1789683687.460646:0:19141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835540224 00000100:00100000:2.0:1789683687.460647:0:19141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835540224 00000100:00100000:2.0:1789683687.460654:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:2.0:1789683687.460657:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+10:2402:x1876618835539712:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789683687.460688:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+10:2402:x1876618835539712:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 30us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683687.460692:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:2.0:1789683687.460700:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:2.0:1789683687.460704:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+5:2401:x1876618835539584:12345-192.168.201.50@tcp:9:kworker.0 00000020:00000080:2.0:1789683687.460717:0:19141:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88ac4e 00000100:00080000:2.0:1789683687.460729:0:19141:0:(import.c:65:import_set_state_nolock()) ffff9f0e82e43800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789683687.460766:0:19141:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789683687.460902:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1acf7a90-98f6-4b44-899e-7c61b5867591+2:2401:x1876618835539584:12345-192.168.201.50@tcp:9:kworker.0 Request processed in 196us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683687.460906:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:2.0:1789683687.460914:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:2.0:1789683687.460917:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2401:x1876618835540096:12345-192.168.201.50@tcp:9:kworker.0 00000020:00000080:2.0:1789683687.460930:0:19141:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88ac8d 00000100:00080000:2.0:1789683687.460934:0:19141:0:(import.c:65:import_set_state_nolock()) ffff9f0e82d54800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789683687.460951:0:19141:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789683687.460986:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+2:2401:x1876618835540096:12345-192.168.201.50@tcp:9:kworker.0 Request processed in 68us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683687.460990:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:2.0:1789683687.460998:0:19141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00100000:2.0:1789683687.461001:0:19141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0e83caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+5:2401:x1876618835540224:12345-192.168.201.50@tcp:9:kworker.0 00000020:00000080:2.0:1789683687.461008:0:19141:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf8485587b88ac94 00000100:00080000:2.0:1789683687.461013:0:19141:0:(import.c:65:import_set_state_nolock()) ffff9f0fa5320800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789683687.461022:0:19141:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1789683687.461062:0:19141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0e83caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8ad19e05-bbf9-4d06-b3fa-15d4caed94e2+2:2401:x1876618835540224:12345-192.168.201.50@tcp:9:kworker.0 Request processed in 60us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683687.461066:0:19141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00080000:2.0:1789683687.461089:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789683687.461091:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683687.461093:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683687.461096:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789683687.461274:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683687.461281:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683687.464343:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618835539200 00000100:00100000:0.0:1789683687.464360:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618835539200 00000100:00100000:0.0:1789683687.464425:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 171 00000100:00100000:0.0:1789683687.464435:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0fbfbca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:2403:x1876618835539200:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789683687.464517:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0fbfbca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a4b989-8a1a-4887-96c1-b874fd2dfe72+13:2403:x1876618835539200:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 83us (4470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683687.464524:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 171 Debug log: 43428 lines, 43428 kept, 0 dropped, 0 bad.